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ABSTRACT 



The document is the final in a series of four 
competency*based modules produced for isse vith inservice teacher 
education programs in consumer education, ihe main objective of the 
program is to assist curriculum develcfers and elementary and 
secondary classroom teachers as they plan, develop, isplement, and 
evaluate a multidisciplina'ry consumer education program* This module 

N^resents numerous exercises to help teachers evaluate student 
performance in consumer education prcgiams and offers suggestion^ for 
evaluating consumer education programsv The module also presents 
pretest exercises to assess knowledge of evaluation technigues, a 
gloi^ary of evaluation terms, and suggestions 'fcr f ollo«-up 
activities such as analyzing poor test items and constructing. valid 
test items. Activities involve the teachers in matching an^multiple 
'choice exercises,, taking true and false tests, jiriting essays, 
discussing evaluation technigues, ^ giving examples of cognitive 
processes, recording observational data, and prcviding justification 
for various methods of evaluating student attairment. Background 
information is presented on norm reJEerenced and, criterion referenced 
tests, collecting and aneKLyzing observaticnal data, test data, 
measurement characteristics, and test validity. Open ccmpletion of 
the exercises in this module, teaches are expected tc be able to 
describe the end products, elements, and processes cf evaluation^ 

. cronstruct test items based upon a given content; and a{>ply basic 
guidelines for writing objective test items. (Author/CB) 
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ABOUT TH^ MODULE ^ * 

This module^ is one of four competency-based modules produced for use with 
.in-service teacher, education programs in the area of consumers' education. The 
principal purpose of the modules is tp assist curriculumr leaders and teachers wil!h the 
*planning,'> development, implementation and evaluation^ of a multi-disciplinary 
consumers' edupation school- program. While ^the, modules do not comprise a 
cbmpfete in-service .program, they provide a substantiel foundation for both 
elementary and secondary teachers. ^ 

Module 1 ' provides -an orientation to this program area and presents a 
generalized curriculum framewdrk for the shaping of instruction and curricula 
outcomes. ... ^ 

" Module 2 presents h ponceptual framework dr-awing on major consumer and 
economic concepts and economic generalizations which hy^ip comprise^'ja core of 
competencies for the^ consumer educator. These concepts and generalizations 
provide the basis for CuiViculum building. . ' ^ 

Module 3 provides a set of experiences designed to help teachers relate'the 
above conceptual fram'ework to existihg traditional school subject's. Several exercises 
are provided to help the, teacher integrate the above concepts' and generalizations 
into an existing curriculum. • * • ^ 

Module 4 provides experiences that will enSRie teachers to improve their 
techniques for. the evaluation of stGdent performance in consumers' education. 

, Procedures for program evaluation are also outlined. ' ^ ^ ' 

Each of the above modules is^a setf-cqntained product intended for teachers to 
complete at their own^»t^. One or all fOur modules can be used to improve 
competency . in a giv^r^area. Each module contains a Terminal Performance 
ObfectTTir^^a competency each teacher should acquire upon completion of the 
module. Er^abling Objectives comprise* subcompetencies teachers should achieve as 

„they proceed through the modble. Enabling Elements contain instructional content 
designed tg.help the teacher meet the Enabling Obfective. Pre; and post-tests are 
provided to. help theneache/ determine whether 'fhe Enabling Objective^ has been 

. mastered, Or^ where additional feview is,necessary. At the conclusion o't the module a 
fojlow^up a^ctivity is suggi^sted. \ ' ^ 

^. ^ We sincerely hope' 'that;. beyoiid creating^ basic teacher competencies in 
Consumers' Educartion; these modules stimulate a Strong interest and enthusiasm in 
this vitally important field, * • " - , s . " * 



RATIONALE, OBJECTIVES, AND HOW 
, TO USE THIS MODULE i 

Rationale ^ . , . « . 

To evaluate U to make meaningful decisions based upon the best infornnation at 
hand. The thoughtful evaluation of the learning/teaching outcomes of c'onsumers' 
education^ is the most effective way a teacher can- assure that the efforts to instruct 
and the' efforts to learn will produce the best results practically obtainable. 

Evaluative decisions may be made during the course of the instruction and 
study 'Of a unit, or at its beginning. The^evaluations conducted at these times lead to 
decisions to continue the instruction and study as it'ls going, to change iyn certair> 
ways, or to start certain students on 'the study of new rfiodules or units. Evaluations . 
conducted to decide whether, and how best tb continue a teaching/learning activity, 
or whether to start a new^one are called formative evaluations. 

.Evaluative decisions, may be made at the close of a teaching/learning sequence. 
The teacher and the students need^to know what has b^en learned during the course 
of the unit, and the teacher must decide upon its adeqliacy and quality. Evaluative^ 
decisions made at the close of a' teaching/learning sequence f^ the purpose of 
summingttip the adequacy and quality of the outcomes are known assummative 
evaluations. Evaluations upon which unif^or course grades are^ based aresummative 
evaluations. ' \ ' . . 

The purpose of this module is ta describe appropriate techniques for obtaining, 
in usable form, reasonably extensive, valid^and dependable information about the ^ 
principal aspects of student, attainment; about the principal types of student input; 
and, about the principal types of teacher input which affect student attainment. 

'Whije it is recognizee! that in thfe making of evaluative decisions information 
•pertaining ta other fields (instructional materials, students' , backgrounds, etc.) 
frequently will be needed, such topics are npt included 'in' this module, the 
objectives to .which the content and activities of this module are directed are stated 
below. ^ ' 

Terminal Performance Objective ■ ' ^ 

Given the information and exercises presented in this module, the^teacher will 
demonstrate a mastery of its conterft by responding 'correctly to*70% bf the t^st' 
Jtems included in a*terminal test covering its enabling-objectives. 

v • / 

Enabling Objectives ' , • ^ • ^ 

,1» Describe evaluation in terms of (a) its^end pi-oducts, (b) its elements, and (c) its 
processes. - ~ ' "... 

2. .State the prihcipal differences between test data and other observational dat^. 

3.. Describe each of five type^of test items Jn terms of their respective forms. 

4. Describe each -of five ty(5fes;of test items in terms of, the cognitive skills and 
processes that presumably will be used by students answering themr * 



5. Apply basic guidelines for the writing of all objective items. 

6. Explain the meaning and the importance of^test validity. 

7. "^ Explain the relationship between content and process validity. 

8. oWrite items based upon* a given content which wilj illustrate each of six 
i cognitive skills or processes. . , 

9/ State the difference between norm and criterion referenced tests and illustrate- 
uses of each reference system. 
'1^. Sta.te valid reasons for considering pbservatipnal data other than tes^ scores 
when evaluating student attainjnent. 

11. Describe a technique for recording such data in usable form.' 

12. Describe ways in which, such data may be utilized yvhen making e\Aaluative 
/ decisions. • , " ' • 

^3. ^State professional reasons for documen^ting teacher input. 
14. Use a fornn for documenting teacher input. 

i 
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PR£-A^S^SSMENT 



Purpose 



The purpose of the pre-assessment js to enable the reader to ider/tify'the 
sections of this module that he/she would benefit by studying. Each item in 'the 
•assessment; oY'test, is tied to the section, or Enabling Element, of the module that 
pre,sents the content tested k(y tbe item. By following the directions to be given, the 
pre-assessm en twill identify the Enabling^Elements each person sHouJd study. 



Directions 

1. Prepare an answer sheet by writing tfie numbers from 1 through 20 in^cplumn 
about one inch from the right edge of an ordinary sheet of paper. On this answer 
sheet/the answers can ^e written along the right edge of the page. They will be 
easy to score. (You may record your answers in the book, but scoring will be 
difficult.) 

2. Read each item carefully, and re^d it completely. ^ ^ 

3. ^fi^r.. each item, there ^are a number of alternatives, or choices. Select the 

alternative that seems to be true, or to 6e the best one given. Write the letter 
-number of that choice beside the num'^er of that item on the answer sheet. * 

r 

4. Turn the page, and work connpletely through the pre-assessment. Try all^items, 
but if you cannot nnake a choice, leave the ahswer,space blank and go on to the 
next item. 

5. Turn the page and begin. 
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PRE-ASSES^MENT 

Read each of the follovying statements carefully.. Each is numbered. Some are 

TRUE; some are FALSE. Select the answer below which gives the numbers^ of ALL 

statements-which are TRUE. - ^ 

c 

1. Any process by which data are collected is evaluation. 

2. Evaluation conducted at the close of a sequence, or a period of instruction, is 
summative if it produces a decision about the value or pnerit of the outcomes of » 
the activities^ over the sequence or period. 

3. To be an evaluation, the decision must be based upon terms^which can be clearly 
identified. , - ^ * 

4. For fc^rm^tive evaluation, clearly stated terms and dependable data may be nice, 
but' really are not necessaiy. 

5. For good evaluation it is ^absolutely hecessary to dev&to^a comprehensive plan, 
, and to carry out the plan. ^ 

>^ 

.1. In the paragraph above, the TRUE statements are4hose numbered: 

A. 1,3, 5 ^ - . , ' 

B. 2,3, 5 

'C. 3,4;5 ' • • , 

D. 2, 4, 5 ' ' ^ . ' 

Itenris 2 and 3 pertain to data obtained by administering tests and to data 
obtained through cither types of observations.' Read each statement carefully, tjierh 
mark the letter number of the alternative which iSctrue of it - . 

2. The data usually can be checked by an independent observer. 

A. The statement tends to be more true of test data than of other 
observational data. " ^ c ' . 

# B/ The statement is equally true of data obtained from tests and from other 
^ types of observations. 

C. . The statement tends to be more true of other observational data than of 

test data. -i 
^D.^ The statement js true of neither. ^ 

3, The data, may be affected* to a considerable degree by personality factors in 
the observer. 

A. The statement tends to be more true of test data than of other 
• observational data. 

r B. The statement is equally true of data obtained from .tests and from other 
types of observations. » 

C. The statement tends. to be more true of othef Observational data than of 
test data. 

D. The statement is true of neither. . ^ y ' - • 

4 - 
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Answer items 4 and 5 by matching each "item type on the left witPi its 
description as often as you wish. . - ' ^ 



Item Type ^ 

^ ^ 4. Alternative resppnse ' 

5. Multiple choice 



> . Description 

-A. A statement or question followed 
by three or more possible an- 
swers, 'only one of'which is cor- 
rect or clearly the best ^ 

B. A statement or question contain- 
ing a blank into which the student 
is to write a word or phrase ' 

C. A question or statement of a task 
' for which the student is to write 

his complete answer ' 

.D. A question or a stateo^ient to 
which the student Is to indicate 
^ his^ choice of two possible an- 
swers, ' 



In the column on the right .below/ five cognitive skills and processes are listed 
and wumbered. For the iterp type listed in question 6 and in question'?, select'tbe 
alternative which records the numbers of the several cognitive skifls and processes 
for' which items of that type can be used effectively as measures. 



Item Type 

6. Multiple choicei, 

A. 1,3,5 

B. 2,4,-^ 

C. 1,2,3,4 

D. 5, 4, 3, 1 

7. Essay; - 
A- 1,3,4 

' B. 2,4,5 . 
C. 3,4/ 
D. 



Cognitive Skiil§ and Processes 

1. recall of information 

2. ilinderstanding 
,3. opinion vs. fact 

^ 4. sequeni^ing 

' 5. organization and' e>cpression of 
•personal reactions ^ 



f -^he statement in each of the* two following, itenos may, of may not, be a good 
guideline for^ the writing of objective test items. Read ^ach, apdchoose the response 
vyhich best describes the statement as a guideline. ' . ^ 

^ 8. When .wording item stems and the alternatives; use absolutes (always; never- all- 
nq(ie, etc.) - • - ■ 



A^. 'generally correct ^ ^ 

B. not correct, because they generally signal an incdrrect answer 

C. . genfer^lly okay, because their use makes item writing easier. 

«> " » • 

'9. Errors students have made in the course of their study are the best source of 
erroneous alternatives for test items. 

A. false, because the studehts shoul(^ not meet their errors on test 

B. w^f^ther tru^ or not, -it is unethical to use thejn because their^use will make 
the itqnris tricky * ' * , \^ 

• £. corcect;^ as stated. , - V / 



10. The validity of ar^test is its most important property. 

A. false, b^au^e the processes it actually measures are mpf'a^important 
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B. true, no other quality can make up for poOr validity, but good validity can 
compensate for other ppssible weaknesses • . - 
false, because. if id^not valid for^the purpose written?; it still may produce' 

.,D. true, because vali^y is. a. general propi^rtyJndepenoSit of the purposes of 



interesting resultlj 
true, because' vali 
the teacher and characteristics of the students.^ 



• Read .each gf the numbered* statements very >carefally"1Jp then select the 
al^^native below ^which lists the numbers of all that are 




. .> ' ' Content andTroeess Validity ^ ^ ^ 

ly If jthe items in a teit deal with the content.actuaMy covered in a unit 6<jnodule, 
^ the test possesses content validity^ - ^ 

2. If*the items require ^the students to eflpploy tjie cognitiv^ pr.ocesses'ujili; 
their study. of the'content, -the test possesses process validity^. 

3. Content canjie4ested wfthout involving one or. snore cognhti\^e*processes. y 

4. kacTi cognitive proems mu-st be tied to s'6nrie, element of cgn teat;, because each 
process ^qiust operate upon some content; that is, process^es canjjdt operate in the 
abstract. ' . . \ \ % ^ 

5. * Any cognitive process can be tested l^y a single -item if the iljem' deals with. 

"^^'^uitable content. ' ^ . - ' 

* ' 1- ' 
11. I judge the TRUE statement's to be: - , 

A. 1,4, 5 

B. 2,3,5 
° C. 1,4 

b'.' 1,2,4 . ■ ^ 



For each of the next two items, select the letter number-from the list beljj)w *c5f 
^theioognitive skill or process ^hat students probably wouid use in responding to it. 
'You may use any skill or piocess as often as you wish. " * • . ^ 



Skill or Process 

I ^ * A. .^enec^lizing , 

B. inference " ' 

C. classification * * . 

\' D/ hypothesis developn;ient 



12. A girl found that she could inyest in each of the following types of securities at 
•th^ interest rates shown below: " , \ 



U.S. savings bonds - 3.75% y 
nfitionaf b&nk savings account^ 4:5% 
savings and loan account -.5.0% , \ ^ 

first mortgage on a home - 6.5% , \ 

second-mortgage op a home - 8.75% ♦ 

In one short sentence^^vyhar probably accounts for the increase in interest rate 
as the types of investment change as you read down through this list^ 

^ i§ki.ll or process numbered probably would be used by student 

respocidjng to thisf'/itj?rftr. 



13. 'A number of fibers are listed below. Write the letter before each indicating 
whether if js: ' ^ - 

• linen • " 

s 

dacrorj - , 

^^""'^'^j wool 

. I cotton . 



A. ^ a^?!||||nimal fiber 

B. ^ a vegetable fiber 
C a^nthetic fib^r 



\ 



nylon' 



c 



Skill or process numbered probably would be used by stuflents 

responding--to this item. > . > ' •, ' ,y ' 

^- :' 

14. A teacher stated that two students failed to answer correctly 80% of the 
questions on the test on the module they had just completed, and that'these 
wo students therefore could not undertake the study of th^-next module. 

Q^viously the teacher was interpreting tfTe test results in: . - *^ 

A. : a norm referenced manner 

B. '^'an^errorneous manner ^ '^r^. , ,v i ... . 

C. a criterion referenced manner 

D. an unethical man 
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Which' of the following are the two most Jjnportant reasons fo; considering 
observational data other than test score^^en evaluating* student attainment?* 

Most Important Reasons ' Possible Reasons • * ,^ ' 

A. I, 2 1. Certain t)bjectives can be assessed only 

in terms of the behaviors of. students in 
1,3. the course of their activities. 

2. Some students do not da well on tests. , 
C. *2, 3 3. Some things- students do probably indi- 

cate that changes in their learning are' 
3, 4- . ' ^ taking place before the results show up 

on test scores. 
4. .Observations of other behaviors gijj^ 
the student a defensible basis* for 
awarding better grades to some stu- 
^ ^ dents and lower grades to other stu- 

dents. . 

The following paragraph contains, statements describing' a technique for 
recording observational data other than test scores. Not all of the statements 
may be correct. Read 'the paragraph carefully and choose the. alternative which 
lists the numbers of the statements vvhich are correct 

The numbers of the ^ • 

correct statements: ' Description * . . ^ 

A. 1,2,4, 6 • (1). Observations of unscheduled student be- 

havior shCuld be recorded as anecdotes,' pri- 
2, 3, 4 ' ^ marily for use by the teacher making the 

observation. (2) Each record should state just 

C. 3, 4, 5, 6 what the student did .and contain a brief 

notation of the circumstances under whioh the 
2, 5 'behavior ogcurred. (3) Each entry also should 

cQntain* the teacher's inferences about'the stu- 
dents' motives and the affective effects upon 
other students. (4) Prior to making the actual 
observations, the teacher should decide just 
what behaviors she will look for, and list them, 
keeping the list brief. (5) The behaviors to be' 
observed may include any that interest the 
teacher, because she has no way of knovving to 
what she will relate them. (6) A simple note- 
book page for each pupil,- listing his name, 
' providing a column for dates, and blank ^pace 

for recording the observed behaviors probaLil^is 
- • the best record system to start with. 



17. Listed on the right are po^ible ways of using observational data. Choose from 
the alternatives on the left\^e one that lists the generally advisable ways of 
usrng observational data. 



Generally advisable ways 
to use'other. 
observational data 

A. 1,2,3,4,5 



B. 
C. 

4 

D. 



2, 3, 4, 5 
2, 3, 4 -' 
1,5 ' 



Possible Ways 

1. Quantify them and treat, the resultWiathe^ 
^ matically. 

2. Plan how best to use tbe records for all 
^students. if th-ey will be used in arriving at 
the grade for any studen?. 

3. Use the records for counseling individual 
students and in conference^with individual 
student's parents. 

4. Use them as one part of a student's record, 
being aware that the behaviors recorded 
constitute only a part of the total of any 
student's behaviors. 

5. 0se them in a completely unstructured and 
\ <. unplann'ed manner so you will not prejudice 

the-behgyiors of anystudent. 

18. Which of the following are valid professional reasons for^documenting teacher 
input into the learning/teaching process? ^ 



Valid Reasons 
A. 1,2,3 



B. 



1,2 
2,3 
1,3 



Possible Reasons 

1. Document'lng the several things the teacher 
does makes them evident to the teacher. 
Documenting ^the several things the teacher 
does provides evidence that the teacher did 
do something. 

Documenting the several things a teacher 
does enables her to redistribute her effort 
and thus become more effective. 



2, 



3. 



Classify the specific teacher activity given in each of the two following 
questions by recording the letter^number of thejype of teacher input to which it 
belongs from the list on the right. 



Specific Tgacher Activity 

19. Wrote items for end- . 
ofunit test (1 hjpyr) 



Type of Teacher Input 

'A. Planning and Preparation: Strategics 

6. Other Activities: Independent Study 

C Direct Instruction: Large Group 

D. Direct Instruction: Preparing Tests ^ 
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20. Prepared presenta- 
tion on Consumers' 
Education for par- 
' ents' club (2 hours) 



A. Belated Activities: Committee 

B. Relate.d Activities: Community * _ 

C. Planning: Assemble Instructional Materials 

D. ' Direct Iqstruction: Large Group- 



INSTRUCTIONS 



Y9U may check back over any items if you wish. ' ? 

Turn the page and^check your answers with those given in the Answer Key. 
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) DIAGJMOSTIC: ASSESSMENT 

• ' ANSWER KEV/ENABLING e'LEMEISIT RELATIONSHIPS 

Directions: Check your answers against the, correct answers- given in column two 
befow. Record as your score the total number of items ybu answered correctly. 

Then for eaph item answered incorrectly, study the corresponding enabling element 
given below. It is suggested that you study the enabling elements in numerical order 
(for example, enabling element numbered 5 should be studied before enabling 
element numbered 7). ~ ,■ 



Diagnostic 
Assessment 
Item Number 

1 . 
. 2 
3 
4 

5 ' . 
' 6 ' 
, - 7 
8 
9 

10 - 
1l 

• 12 , 
13 
14 
' 15 
- 16 
' 17 
J8 
% 19 
20 



Correct 
Answer 

B 
A 
C 
D 
A 

rC 

'D 
B 

r 

D 

A ■ 
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GLOSSARY 

\ • 

Content-the information, subje^ matter, ideas, etc.,, presented during instruction 
and presumably to be tested.^ ' . - . * \^ 

Enabling Element~th6 information printed in a modu?e to enable the reader tb 
'attain the objective to which it is related. 

Enabling Objective-one of the quite specific, smaller objectives, the attainment. of 
which will contribute to the mastery of the larger terminal objective. 

Generalization-a general statement linkirrg two or more concepts; a principle. 

Inference-an explanation an individual develops to explain, or account'for, the 
* occurrence of a relatively complex event. 

Itenj Alternative-one of th^hoices offered as a possible answer or correct response 
to an item. ^7 \ 

Item Stem~the basic statement, proiDOsition/or question with which a test item 
deals. ' 

Observational Data-records of events qf of performances actually oiis.ervefkor^seen; 
contrasts with hearsay.records, beliefs, "hunches," etc. 

Process-rrlanner in which content, as defined above, is handled (manipulated) in the 
mind. A process is a way of mentally handling one or more ideas. \ 

Reliabilityythe d'ependability of test results in the sense that if the same measures 
were given to the same students again under the same conditions, the results 
•would be tkie same. 

Supply Type )tems-items;^at offer students no alternatives or choices of answers. 
Typically they contain blanks in which the student rnust write in, or supply, the 
correct word br phrase. ' _ \ 

Terminal Performance Objective-the thing the student is to be able to do upon'the 
completion o-f the module presented. In thjs module, the terminal perform.ance 
objective is to answer correctly 70% of the items on the Post-Assessment. 

Vafidity-the extent to which a tpst measures precisely what it was written to 
measure", and measures nothing else. • 




ENABLING ELEMENT 1 

I 

I 

Evaluation in Consumers' Education 

^ Evaluation is a process wWcfe leads to ^a decisiot^ as its end product. The 
' decision may pertain to the outcomes of a fiastcourse of.lction, or activity, and be a 
statement of the extent or the value.df the outc^)mes. Fbr example, at the close of a 
reporting period, the teapher revleyvs the reco^ri-of the work done by a student, 
•decides its value, and awards the grSde which best expresses the decision made. This 
type of decision is a summative evaluation: * ' . 

^ . The end product of an evaluation may be a decision made for the purpose of 
formulating new or modified lines ^of^action, or strategies, designed to imprpve 
future outcomes over those realized in the imrfiediate past. This type of decision Is a 
formative evaluation. A teacher, on the basis of a short check test and observation of 
the students' study behavior, may identify a half dozen students who are not 
achieving satisfactorily, and who appear to be stymied in their study efforts. The 
teacher evaluates their situation, that is, makes a decision, for the^ purpose of 
^nabling them^ tq. improve their future achievement. The types of decisions may 
vary, and the purposes for making them may vary, but a process must produce a 
decision if it properly is to be called an evaluation. 

But alf decisions are not the.end products of an evaluative process. We all make 
^ impetuous decisions, and are unable^to explajn.how we arrived at them. Such arajnot 
based upon an^evaluation. An evaluation results in a decision for vyhich \Ve.carUtate ♦ 
the elements that entered into its making. By trie elements we^ mean the 
components, factors, or considerations upon which i( rests. For example, a clear 
statement that students' grades will be based upon, their* test scores, their written 
class work, tHeir participation in class discussion, and observed indications' of 
changes in their values and attitudes affords a basis for making decisions thfat 
properly -may be designated summatiye e\7c/luations. 

to utilize the stated com^gMnts^factdrs or considerations in the making of 
evaluative decisions, teachers must have -an adequate amount of valid and 
dependable information, data, about each. To obtain such data, plans raust be 
instituted for its collection aWd for its processing into fcfrms that are usable in the 
making of the decisions to be macje. For example, if the students' term! grades will 
be based, in part, upon the average (or median) of the percentages of the questions 
they answer correctly on each of three tests, the tests must be planned, .the items 
written, the tests administered, the answers Scored and the scores processed to yield 
data'lfl&usable form. , 

In summary, an evaluation is a decision pertaining to a clearly stated subject; a 
decisjon^for which we can identify the components, factors, or considerations that 
entered inta its making; and a decision for which we possess and utilize valid and - 
depf^ndable data pertaining to each component, factor^^or^^ppsideration that entered 
into its'making. 

In terms of the proeesses involved, it is necessary to develop a plan which states . 
just. what is to be evaluated; states^the components, factoids, or considerations that 



wilh erfter, into the making of the decision or decisions; specifies the data needed for 
each component, factor or/consideration; an.d indicates the means by which each 
type of data will be obtained and processed into usable form; carry out therf)lan for 
data collection and processing, and utilizing the data obtained, make the detision or 
^Qfepisions necessary to e\?aluate ^he ppoduct or process stated. 

'Most teachers do hot have much diff^ijulty in detecmining just what they wish 
to evaluate. Wjth isome thought, theyHypically can determine the components, 
factors, anrf considerations that should enter into the niaking Df their decisions 
about the outcpn^s or processes they decide^^to evaluate. Because obtaining an 
adequate amounf^of valid and dependable data pertaining to. each component, 
factor, or consideration, and processing the data into usable forms are the recurring 
.problems, these are topics addressed in much oi the remainder oT" this module. 




PRACTICE EXERCISE 1 



In^anoth^^ module you were presented the concept cluster: Productton and 
Cc8»sumptlon|)f Goods and Services. It dealt specificaTly with the concepts.* 4 ' 

'•. A. Gook J 
Servfce 

Protftjction apd ConsUmptiqrr', 
behold " . 

tal "Good 
ributibn 



c. 

D. 
E. 
F. 



Assum^hat 'Vou will tea^h this concept cluster to pupils'ilrSlite fifth grade, and 
that you wiJ|evaluate the effeclivepess of the learning/teaching activities. , 

In the,|j<ercise below, three essentials of evtaluation are listed in the column on \ 
the left. Pm each essential in the first column, record the letter nunlber of the ^ 
descriptionljn the right that best f it^it. > * ^ * 



Essentials 
in Consur 



Evaluation 
rs' Education 



decision pertaining to 
la clearly stated sublect 

.2.J;Clearly identified com- 
ponents, factors, or con- 
I'^siderations that will en- 
ter into' the evaluation 

Valid arid dependable 
data to b6 utilized when 
making the evaluation 



A. 



D. 

I 



Description of Possible 
Essentials. • 

I shall base my decision upon scores on 
an 18 item test made up of three.items^ 
pertaining to* each concept. Correct 
^responses to any two of the^three items 
pertaining to^each copcepj will be 
accepted as evidence of mastery of that, 
doncept. 

Which of, the students can proceed to' 
the nexfconcept cluster pn'the basis of 
.their having mastere\five of the six 
cbncepts presented in this-cluster?^ 
Students are so different, and J know 
my students so well that J \vill just 
decide which 'ones need further .study • 
before going on to the next concept , 
cluster. 

Following each student's name, I shall 
record in order the number of ques-^ 
'tions pertaining to each doneeRt an- 
swered correctly, and then courit the 
number of "2's" and'"3's" fd^ each 
student to detprrViine how many of the 
six concepts were mastered. 



Check your answers- with 
tf^^cey on page 17. ^ 
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PRACTICE EXERCISE 2 



the cblumn on the left lists five Teacher's Activities and the colutnji on the 
right lists the three principal Evalftetfon Processes. Match each activity with* its 
process by recording the letter number of the processln the space prfe^eding each 
activity. Use any process as often as you wish*. ' ♦ ^ 



Teacher's Activity 



: Administered a^est on the con- 
cepts in t-he cluster* .entitled 
"Production, and Cohsumption 
of^oods and Services" 

.'2. TdTd the class that whether or 
not a student may go on to the 
next concept cluster will de- 
pend upon mastery of five of 
the six concepts in this cluster, 

. 3. Scored thg test in terms of the 
number of questions pertaining 
to each concept answered cor- 
rectly by each student. 

. 4. Counted the number of con- 
cepts fpT which each student 
individually answered correctly 
2 or*3 questions-, and if the 
total was 5 or more, placed him 
in the group to study the next 
cluster. 

. 5. Mastery will be deternnined by 
responding correctly to two out 
of three questions pertaining to 
each concept. 



Evaluation Process ^ " 

A. developing a pfan for the total 
evaluatiojn " ^ 

B. carrying out the .plan fqr data 
- cotlectldn / * • ^ 

C. ^utilizing the data in making the 

evaluative decisions ' . 



V 



1 - 



5^ 



Check your answers wfth 
the key on page 17. ', 



1^ 



Key for Practice Exercise 1 



1. B _ 

2. A 

% 

^ 3. D , 



% 



- 1 



^-4 



Key for Practice Exercise 2 
1. B 



» 2. A 
3. B 

, 5. A , 



-4: ^ 



1 
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. ENABLI5IG ELEMENT 2 



Similarities Differences Betweenjfest Data and 
Other Observational Data Pertaining to 
" ^ Student Attainment^ . 

» * . 

Student attainm©n1t enters into most evaluations in whict^teachers are involved.. 
Some aspects of attainment, such as knowledge gained, skills mastered-, attitudes 
developed, etc.', may be the subject of the evaluation, or they may be th^lemehts 
. upon which the effectiveness of something else (teaching strategy, for instance), is to 
be evaluated. D^ta pertaining to- student' attainment may be divided into two broad 
types: test data and other observational data. * * 

--^sically, alT data are records of observations made by somebody or reported to 
.have been made by somebody. All are records of real or purported observations. The 
datum that the time of sunrise on a given day was 6:20 a.ni. is.'onp whose accuracy is 
subject to independent verification. The datum that a.-ghost appeared at a certain 

^ spot at a certain time may be a record of a reported observation, bu-t it is not subject 
to independent verification, SMid hence its accuracy is subject to question.^^ozen 
people standmg near each other, all having synchronized chronometers, ^obably 
would have differed in their reported times of sunrisp by only a few^ seconds. Tfie 
reported time was reliable -within a small margin of error. The reports of a dozen 
people near the spot where the jj^host allegedly^ appeared doubtless would vary 
widely among themselves. Hence the reported sighting would have low reliability. 
Sighting the sunrise is a valid way of determining its titne-of rising. Sighting a ghost' 
may be a valid' way of establishing the reality of ghpsts, but the accuracy ^rtd 
reliability of such data are so poor that the validity of the reported sighting well may 
be questioned. While all datq used in evaluating educeltional outcoiVies and processes 
should originate as observations, in practice they vary greatly in terms of their 
accuracy, reliability, and validity. . * , . - / 

Xests yield records of the actual performance of the ^tud'ent taking the test. The 
records have a certain permanence, and are there *for- anyone to see and t* examine. 
' This much is true of all types of short answer tests, gf essay tests, and of tests 
requiring the production. of a durable product like a picture' or a piece of furniture. 

Ol^ef' observations may deal with transitory behaviors,* lacking any degrfee of 
permatience and leaving no record in and of themselves. A nod of agreement with an 
expression of a value; a student obviously comparing the advertfsements.for two 
garments; setecjing an orange instead of pie at the cafeteria. counter may be observed 
only when and while they are happeniVig, and in and o^ themselves they leave no 
record. They* cannot be re-checked, and cannot be examrRed by anyone not present 

* at the time of their ocoorrence. 

Data derived from tests may Be obtained whenever they are .desired. The 
obtaining of test data is completely contr6llable by the teacher desiring to make that 
type of observation. Observations of other behaviors generally must be made 
whenever they occur, and their occurrence is unschedaled ancj generally uhpre- 



dictable and uncontrollable. Under sOch chrcumstances, the teacher misses observing 
TRe occurrences of many behaviors, and hence the da'ta pvtdtning to them generally^ 
uncjerstate their frequency by some-unknown amount/ * /^'^ 

Test data practtcafly are frep..of personality differences vA^hch r^ay greatly affect* 

\, those derived from other observations. All students' make the same Wpes of records 
on their ansvyer sheets, and these .records are equally obseo^able byaill te^aehers. The 
observabl-e manifestations of affective responses vary greatly from student to 

• student,_being^fairly obvious for some, and practically undetectible for others. 
Teachers, toCf,--vary in their ability to detect such responses. Some are, quite 
percefftive, and others simply are not. /'A II probably ard selective in the^ detection of 
affective responses. Eacfi "person is more. Iik,ely to detect responses siiiJbr to those 
he makes, -than to detect responses which are not. Student differencesTnd teacher 
differences Combine to lower the /eli^ility and even the validity of much 

. observational data.^ , 0 > 

Not all test data are equally objective, valid, and reliable. Generalty data derived 
from so-called objective tests in which the student marks -one correct answer are 
■quite dependable. "Data derived from essay tests , generally are somewhat lesst 
dependable because of scoring problems. -The students' answers vary greatly* in 
accuracy, completeness, style and leg^ility. Determining precisely howjnuch each- 
student knows IS difficult and the teacher's standards may shift during the process of 
■ scoring the papers. Deriving accurate data from objective tests is relatively easy; 

' deriving ac9Airate^ata from essay tests is more difficult and the dependabilfty of the 
scores derived^ften is affected adversely. • ' , 

Data derived' from tesp -generally originate in humerical terms, being the- 
number of questions answered correctly or the number of points made on an essay 
test. They maybe noanip^'ulated^ b%^sing common arithmetical processes. Thus the 

^ raw data. may be converted into percentages, into^some standard scale values, their 
averages c<^mputed, rankeid,, and grouped as the teacher, niay wish. Each step in the 
process"from scoring to final reporting may be checked for accuracy. . ^ 
. Data derived from most other types of observations originate fif verbal terms. 

" They rleport the 'teacher's observations. Therefore, the data are subjective reports 
whose precise meaning may hot be clear to another reader, or even, to the writer 
after a period of time. Being verbal reports, their processing and synthesis is difficult 
and hot exact. Typically, the data^can only be reviewed, and^ubjective judgments 

vnr^ade about the frequency and qC/ality of the behavior described. If attempts are. 

^ ^made to; convert the data intcCnumerical terms, the resulting data retain all the 
weaknesses o^ the original verbal reports. Additionally, the data assume the 
weaknesses of nominal or coarse ordinal measures with AA/hich little properly can be 
done, arithmetically. 
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PRACTICE EXERCISE 3 

Check the correct coltirrtn, <'true" or "false." . • ' 

•i 

Compared to test data, observations of other types of student behaviof.-are: ^ 

1. more perfnanent ^ ' ^^^ 

2. rn€)pe^padily confirmed hy other observers* \ 

^ 3. less.easily interpretect \ t . 



I 4^ more accurately treatabl'e^by ma'th'^^^^ica I processes . * 

^ ^ 5. less. reliable^ . • '-^Jfc** ^ 

• 6. more objective ' ' ' 

7. less complete 



^Gheck^your answers below. 



V 



s 

il^L .'d-9 -l-Q -d-t^ -l-C -d-C 'd^L :sja/wsuv) 



ENABLING ELEMENT 3 

. . , ^ Formal Characteristics of Each 

•■' ^ •' of Five Item' Types 



Figure T, whiefi follows; supplies in its second column a brieVdescription of the 
form 6i each of the fivje mos^ cd.mnTonly.used types of items, namely: multiple 
.choice, ^matching, alternative >e§p6fl|l, suF5ply,.and essay. In Figure 1, the form of 
test items will be descVibedvohTy ^n. terms of their ess&citial eleVnents, or parts that 
mtjst be'^preseO'ted tp^cortipose an item of the type designated^ 

For each type of test item ;Mste4Jn column.^ read carefully the description of 
its form m colurT|n 2. ^hen;^ry Pr|btfcd Exercise?, which' follows. ' ' - ' 





% ■ 
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Item Type 



Figure 1. Characteristics of five types of items in terms 
of form and of processes measured. 



Form 



Cognitive Pr6cesses 



1; Multiple Statement, ,or stem/ plus three , 
Choice - ' or more chorees, one,'and Only 
one of which will correctly 
completle the statement or an- 
swer the question pnesented in ' 
the stem. Typically, the stems 
are numbered as questions, 
and the choices are lettered a, 
b, c, 



Efficiently measures recaT^ of 
knowledge of factual informa- 
tion. Can also b^ constructed 
as an effective /measljVe of 
unders'tandings, thinking a<ills, 
comparison, contrast, sequenc- 
ing, opinion vs. fact, etc. Not 
recommended to measure or- 
ganization and expression of 
personal thoughts, reactions, 
etc. 



2. Matching ' Stem directs stud^t to" select 
^ from the entries in one col- 
umn the one or more which 
are associated ^ with each ob- 
ject, process, or attribute list- 
ed in the other of the two 
columns immediately follow- 
> ing. 



pfffciently measures recall of 
knowledge ofjactual material. 
Can also be constructed to 
measure effectively under- 
standings and selected, think- 
ing skills, comparispjT^^ con- 
^rast,^ sequencing, opinibn vs. 
ifact, etc. Not recommen^ted to 
measure organization' and ex- 
pression of personal thoughts, 
reactions, e^c. 



Alternative Statement cir stem states a 
resp6nse proposition to which alterna- 
^ tives offer two reasons that are 
opposite in meaning; often ' 
true-false; fact-opinion; 'greater 
than-less than, etc. Items gen- 
erally are brief , ' 



Efficiently measures knowl-' 
ecjge of things or events that 
naturally can exist in only q^ne 
wayiSr in the opposite way, or 
that can be represented as so 
existing. Has very, limited 
value as means of measuring 
higher order cognitive pro-^ 
cesses without making the 
stem coiViplex and involved. 
Cannot be used to measuYe, 
ability to generate*", compose, 
and express studerPts' personal 
thoughts, re9Ctiohs, etc. 



Statement or stem requires the 
supplying of a cr44ical word, 
phrase, or short clause at the 
point indicated to complete it, 
makiog it true. Different 
words or expressions may be 
used provided their meaning 
does not differ from that of 
the expected response. 



Efficiently measures recall of 



knowledge of factual informa- 
tion, ^ay be used to measure 
other cognitive processes and 
skills, but to do so, the stem 
may become so complex that 
serious reading problems re- 
sult. Not recommended to 
measure organization and ex- 
pression of personal thoughts, 
reactions, etc. , 



Statement or question clearly 
specifying the subject and the 
manner and ^terms in which 
the student is to respond to it. 
Sufficient blank spa(^ should 
be provided immediately fol- 
lowing the stem for the stu- 
dent to write the response. 



Not recommended for the re-» 
call of factual -information 
and, in most instances, not for 
the measurement of under- 
standings an^^ several other 
cognitive skills and processes 
because other item types rpay 
be used to do so more effi- 
ciently. Effective . measure- 
ment of dbility to organize 
and express personal thoughts 
and reactions, and* to weigh^ 
values and alternative argu- 
ments. 
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PRACTICE EXERCISE 4 



For each item below, indicate its formal type by recording the letter of the 
correct answer. ' . 

a! Multiple Choice '\ . . ^ 

^B. "iVIatching , * r ^ 

C. Alternative Response 
D: Supply ^ ' 

E. Essay 



Type 



1. A beautician produces a good 

A. True 

B. . FalsQ . . 

2. For each statement on the left, record the letter number of the concept 
in the right column with which it^belongs. 

Statement . - Concept 

1 . washing cars - • ' A. Good 

2. grower of potatoes B: Service 

3. an auto tire C. ProdLk:er 

4. a potato 

3. ^ In a short paragraph,;explain the concept ''distribution/' 

4. Goods which are produced for the purpose of producing other goods are 
called ^ 1 , goods. 



Check your answers below. 
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post-assessmeNt 

Read each of the following statements^carefully. Each is numbered. Some are 
TRUE; some are FALSE. Select the answer below which gives the numbers of ALL 
statements which are TRUE. ^ ' • 

\ 

1. Any, process by which data are collected is evaluation. 2. Evaluation 
conducted at the close of a sequence, or a period pf instruction, is summative if it 
produces a' decision about the value or merit of the outcomes of Ihe activities^over 
the sequence' or period. 3. To be an evaluation, the decision must be based upon 
terms which can ^be clearly identified. 4. For formative evaluation, clearly stated 
terms and dependable data may be nice, but really are not necessary. 5. For good 
evaluation it is absolutely necessary to develop a comprehensive' plan, and to carry 
out the plan. 

1. In the paragraph above, the TRUE statements are those numbered: • 

a; 1,3,5 ' ' ■ . 

B. 2,3, 5 ' * ^ . ' 

C. 3.4,5 

D. 2,4,5 

Items 2 and 3' pertain to data obtained by administering tests and to data 
obtained through other types of observations. Read each statement carefully. Then 
mark the letter number of the alternative which is true of it. 

2. The data usually can be checked by an independent observer. ^ 

A. The statement^ tends to be more true of test data than of other observational 
data. ' . ^ ^ ' 

B. The statement is equally true of data obtained from tests and from other ^ 
type& of observations* ^ ' - . 

'C. The statement tends to be more true of other observational data than of test 

data. ' ' 7 

D. ,The statement is true of neither. 

3. 'the data m^y be affected to a considerable degree by personality factors in thq 
obsefver. . ' * ' 

A. The^statement tends to be more true of test data than of other observational 
data. ' , 

B. The statement is equally true of data, obtained from tests and from other ' 
types of .observations. 

C. The statement tends to be more true of other observational data than of test 
data. J 

D. The statement is true erf neither. / ' 




ENABLING ELEMENT 4 



This Resource has two parts. Work through both parts before attempting 
Practice Exercise 5. > . 



Measurement Characteristics of Each of 
' Five Item Types 

^ The types of cognitive skills and processes which each of the item types m*y be 
used to measure are reported in Column 3 of Figure 1. Review Figure 1 and note 
that several of the item types may be iised to measure a wide range of skills and 
processes; the same skill may be measured by using any one of several item types; 
alternative response items and supply items are* limited with respect to the skills 
which they can measure; and essay items should be used to-measure only objectives 
that require the student to put together an original response. 

There are other cognitive skills and processes which the teacher may wish to 
measure, One or more of these item types mgf be used to measure mpst of the skills 
which teachers wish to. measure. It nriay require spme ingenuity to write an item of a 
type which will measure a particular skill. However, with thought and experience, 
the typical teacher can write objective items which measure most of the cognitive 
skills and processes developed in the study of Consumers' Education. 



Problems Inber^nt in the Measurement of 
Cognitive Skills and Processes 

A word of caution may be'in order, ^^^gnitive skill or a cognitive process is an 
'operation which we assume goes on in a student's brain and nervous system. The' 
fact IS that we cannot observe whaj goes on in a student's brain and nervous system, 
and the further iact is that his report of what went 6n often is sketchy or basically 
inaccurate. . 

We may vyrite an item to measure the abiHty to utilize a specific skill, but there 
-is no way of knowing whlat skill actuajly is employed by the student in responding, 
even if the answer i^ marked correctly. It is intelFectually economical to use the 
simplest skill the respondent finds possible, and good practice to do it. Thi^ principle 
leads to the perverse situation in which when responding to a given item the gootf 
student who has a large fund of knowledge will respond by recall,, and the poor 
student with a meager fund of knowledge will employ inference, comparison^. or 
some higher skill in arriving at his answer. As a result, the teacher may accurately 
conclude that 75% of the students were able to answer the item correctly, but the 
inference that 75% can perform the skill the item Was desjgned to measure may be 
tenuous. 



ENABLING ELEMENT 4 



This Resour^ce .has two parts. Work through both parts before attempting 
Practice Exercise 5. - . 



Measurement Characteristics of Each of 
Five Item Types 

^ The types of cognitive skills and processes which each of the item types m»y be 
used to measure are reported in Column 3 of Figure 1. Review Figure 1 and note 
that several of the item types may be used to measure a wide range of skills and 
processes; the same skill may be measured by using any one of several item types; 
. alternativeVespOnse items and supply items are' limited with respect to the skills 
which they can measure; and essay items should be used to-measure only objectives 
that require the student to put together ag original response. 

There are other cognitive skills and processes which the teacher may wish to 
measure, One or more of these item types mgf be used to measure m.ost of the skills 
which teachers wish to.measure. It may require spme ingenuity to write an item of a 
type which will measure a particular skill. However, with thought and experience, 
the typical teacher can write objective items which measure most of the cognitive 
skills and processes developed in the study of Consumers' Education. 



Problems Inherent in the Measurement of 
Cognitive Skills and Processes 



A word of caution may be'in order, ^^^gnitive skill or a cognitive process is an 
'operation which we assume goes on in a studejrfs brain and nervous system. The' 
fact is that we cannot observe what goes on in a student's brain and nervous system, 
Snd the further iact is that his report of what went 6n often is sketchy or basically 
inaccurate. . 

We may vyrite an item to measure theabijity to utilize a specific skill, but there 
*is no way of knowing whlat skill actuajly is employed by the student in responding, 
even if the answer \% marked correctly. It is intelfectually economical to use the 
simplest skill the respondent finds possible, and good practice to do it. This principle 
leads to the perverse situation in which when responding to a given item the good 
student who has a large fund of knowledge will respond by recall,, and the poor 
student with a meager fund of knowledge will employ inference, comparison^, or 
Sonne higher skill in arriving at his answer. Asa result, the teacher may accurately 
conclude that 75% of the students were able to answer the item correctly, but the 
inference that 75% can perform the skill the item Was designed to measure may be 
tenuous. 



PRACTICE EXERCISE 5 



For each of the four item types listed in the first column, check the letter 
numbers of all skills or processes for which thai item typQ may be used as an 
efficient measure. . . 



Item Type 
1. Supply 



A 
B 
C 
D 
E 
F 



J 



2. Multiple choice 

- -A 

B 

' .c , 

D 

E 

F 

3. Alternative response 
A 

* B 

C 

:_ D 

- , E 

F 



4. Essay^ 



A 
B 
C 
D 
E 
F 



Skill or Process 

A. recall of facts 

B. understanding •• 

C. comparison* 

D. organization of personal thoughts 

E. true or false 

F. weighing values 
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.5. If a tfeacher writes a very good item to measure the ability to perform a certain 
cognitive process and a student marks the correct answer, which of the following 
. statements may be true? Check all that may be true. 

A. The student used the process intend.ed 

■ B. The student used a sinnpler process 

C. . The student used a more complex. process 

D. ' The te'acher* really does not know wh^ch process the student used. 



Check your answers with key on page 30, 



'4 
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Key for Practice Exercise 5 

1. Supply 

X A 

2. Multiple Choice 

' X - A ^ , 
X B . ^ 
X C 
X F 



3, Alternative Response 

X A 



4. Essay 



5. Multiple Chojce Question 

. X A 
X B 



■ X C 
X ' D 



r 



ENABLING ELEMENT 5 

•si/ 

Basic Guidelines for the 
Writing of Objective Items • * 

. \ • 

Writing objective test items is an art and not a science. Every experienced item 
writer develops individual guidelines, some- of which are^clearly formulated, and 
othefs whidh are 'fallowed intuitively. Inexperienced writers are advised to formulate 
and to revise guidelines as they gain experience. 

The following list of guidelines is not exhaustive. They are intended to guide^ 
the efforts of relatively inexperienced writers and to be modified and supplemented 
by writers as they gain experience. 

For convenience, the guidelines are grouped under general headings. The order 
of the groupings does not mean that one is more importantthan others, because to 
disregard any of them will spofrthe items v^ritten. 

Writing and Or^nization ^ 

* Employ as simple language and sentence structure as the subject matter and the , 
process to be measured permit. The task of reading the question should Hot interfere . 
with the student's effort to answer it. 

Eliminate all ambiguities in the stem and the alternatives. 
"Oranges, roses, and pinks are: 

a. , colors ^ 

b. plants ^ J ^ ' 

c. fruits," is ambiguous bfecause the items named may be either colors or 
^ plants. ,^ ^ 

Avoid absolutes in wording the item and in the alternatives. "Always, nev^ all 
none; every, no, etc.)" generally '^gnal a false stat-ement or erroneous alternative. 

Organize the presentatidn of the stem and the alternatives so the student finds 
the possible answers preferably along the left margin of the page. The student shoul 
not spend time locating the physical position of ;the elements he needs. Placing the 
alternatives to which the responses are to be attached along the left margin makes 
hand scoring much easier for the teacher. 

.' L ' ' V • 

Item Stems 

'The stem should state 'clearly the terms in Which the student is to respond to 
the stated or implied question. ^ . " ^ 

'Which of the following investments is best in terms of security of the capital 
invested?" is a very different item from "which of the fallowing investments ii best 
fn terms of^ return on the capital invested?" 'Which of the following investments is 
best?" is impossible to answpr. • , 

Except in the case of supply type items, the stem plus the alternatives should 
provide all the elements of information required to respond to the item. 
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. 'The simple interest on $100 for one year is and "The interest for 

one year at 6% on $100 is /'are both deficient. The first omits the rate. TKe 

second probably would be answered one way b\ the poorer studerjts who know only 
simple interest, ^nd another way by better students who may know something about 
compound interest if one of the distractors is somewhat greater than $6.00. 



Alternatives ' . » ^ 

The best source of erroneous alternatives is the errors students made in the 
course of their study of the topic tested. 

\ Generally the correct alternative is easy to write. Students' errors are, or were, 
plausible to' them. By using tKeir errors as alternatives/ the item become^ an 
observation of the extent to which errors have been corrected through the 
instruction and study. , 

For each item there inusi'be one^ and only one correct answer, or the 
"instructions must state that siudent is to mark all that are correct. 

The situation sometimes arises in which the general instruction has pojnted to 
one answer as.cofrect, but on the basis of more extensive information another 
answer properly is judged to be correct. 

'The savings accounts in all savings and loan associations -are insured up to a 
certain amount' probably would be markfed true by students studying only about 
federal s&l's, but false by those knowing that some states charter state s&l's without 
requiring deposit insurance. 



ERJC. 
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PRACTICE EXERCISE 6 



Directions: There are five sample items in this practice. Below each item' is a list of 
alternatives. In the blank provided, check the alternative which describes the sample 
kem/s greatest weakness. 

1. A woeful deficiency in, any family's, department of its treasury is precipitated 
when its gross expenditure ^ceed by large sums the net income it receives, 

True . • ^ 

False' * ^ 



The greatest wteakness of the item as stated is: 

if 

A. It is not really-a "true/false" question. 

By The language and structure are unnec^fssarily difficult. 

. The item is ambiguous. 
D. Not enough information is given in the item. 




2« The best credit card is: 

A, American Express 

i_ B. local store 

C. BankAmen'oard - 

.,. D. Gasoline company 

The greatest weakness of the item as stated is: 



A. The language is too difficult. . - 

B. The arrangement of the alternatives is confusion. 

C. There is a poor choice of alternatives. , 

D. *The term? in which the student should judge^are not given! 



3. In^prest, wages, and medical services of a family are: 

j — A, Sources of income 

^ ' % B. Costs ^ . ^ 
: C. Savings - ^ 



the greatest weakness of the item as stated is: 

^ A. The item is ambiguousf for some families the items, mentioned may 

be sources .of income, and for other families they may be costs 

• ' , 33 3 9 



B. The alternatives represent"'ideas studenW,wouljd.not ordifM^ly have 

C. It uses absolutes which make the correct answeftfear . / 

D. The Qrganization of the item is confaSionr 



4. /f a parchaser pays casl^^she can buy a clothes dryer for $ 160. 00. If^e charges 
it for 30 days, * the cost will be $5. 00 more, What /mfie^^u^^nua/percen tag& a 
rate of interest if she charges? j ^/""^^^^ , 



A. 3% 

B. 'iiy2% 

C. ■'i^^y2% 



The greatest weakness of the item as-stated is: 

A. more than one answer may be correct. , ^ , 

^ B. th^ correct answer is not given " " ^ , 

C. theTblacement of the alternatives is confusing ^' 

D. not sufficient information is given to enable the studeni|to answer 



the question. 



5. All items arways cost more it they are charged ' ^"^^ 
^ ' f True ^ ' ^ ^ 
'—False % ' • ^ 

The greatest weaknesses of the item as stated is: 



A. the^entence structure is pobr * ' * 

B. ifhe use of the two absolutes, "all" and "always" suggest strongly, 
that the statement is false ♦ ' ^ ' 

C. both ansv^ers may be correcjl^^ y 

D. the stem, does not supply all the informStipn needed to respon^jg^ 
the item. ^ 



Check your answers with the key below. 
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ENABLING ELEMENT 6 



, T-he Meaning and Importance o^Test Validity 

\ 

The validity of a test is the extent to which i_t actually measures what it was 
constructed to"; measure. If ^ test was constructed to measure knowledge of 
. terminology used on labels' of cans of food and the students respond purely on the 
basis of their knowledge of that <e^minology-, the test is perte£tly valid. If -their 
responses are based in part upon their ability to read the iterns, then the validity of 
the test is reduced to the extent that reading competence influenced the responses 
actually made. ^ ' , 

Tbe term validity often is used loosely. This loose usagfe causes and sustains 
misconceptions which hinder constructive understandings of test valicJity. The first 
misconception is that a general profjerty called "validity" exists and pan and should 
be inherent in good tests."" Validity as a general property is a fiction, indeed a 
delusion. Validity is very specific. , 

The second misconception is implied when even specific validity,is-~spx>ken of as ' 
an "all-or-none proposition."' Items and tests are valW measures of some specific 
thing to some extent, usually greater than zero .and less-than 10Q%.;Jhe question 
about a test of check writing skills should be "how valid is it?" not "is'it, or is it not, 
"valifl?" In practice, an item or a test should be just as valid as the writer can make it 
for the purpose for which it was written. Almost certainly its validity will be greater 
than, zero, and alm.ost certainly it will be less than 100%. 

For classroom tests, the actual validity of ah item or a test also is influenced by 
the abilities of'the students taking the test and by their prior instruction.' A given 
item or test may be quite*valid'as a measure of check writing skills when gtVen to 
middle school students who can read the kemi easily. It may possess very low 
validity as such measure if given to; fourth graders whose reading problems block 
their efforts to cope with tHfe iteijis. In this situation, it may operate as a'quite valid 
test of reading comprehension, but that is not what it was written to rneasurel 

Another ijiisconception seems to^ be thaj there is some way for a teacher to 
determine in advance just how valid the test, is, or will be. Unfortunately, such is not 
the case. The best a teacher jcan do when preparing a- test is' to exercise the best 
judgment. The apprbpriate question toT be asked is, "Will this item when given to 
these students lead the large majority of them' to respond in terms of 'the 
competency I want it to measure?" If in, the teacher's judgment it will, he/she has 
done the best to obtain operating validity. " ' • - 

The validityof a test f3 i.ts rhost iniportant property. If it actually does measure 
quite well what it was written to measure, it does the job. If it actually does not 
measure very well, what jt -was .written to measure, nothing else that it may do 
justifies its use for that purpose. .. * . . • 

Validity is so important that the basic reason for giving attention to -tesj 
planning, to item vvriting techriiques^and skills,' to test format, to test administration, 
and to test reliability is to reduce to a minimum t'h.ose things which rnight lower the 
operating validity of the ifet when used. ' 

<■ 
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PRACTICE EXERCISE 7 

« 

Directions: For each item below; check the one be^t answer. 



1. If a test measures exactly what it was written to measure and nothing else, it is: 

A. somewhat val id • . 

B. perfectly v^lid 

• .C. • completejy invalid • . * * - 

* ' » * • ' 

•2. A really valid test'is: - • 
1 A. valid for stu<^ents of any age 

B. valid for any content j 

C. valid for any cognitive process 

' D. 'vafid for certain students, and for a certain content and a certain 

process 



3. A test written by a teacher gerterally is: 

^ A. valid to some extent, but not perfectly valid \ 

^ B. totally-valid ' 

C. totally invalid 



« D. not affected by validity 



4.^ To prepare valid tests the teacher should: 

A. use a statistical formula C 

. B. disregard the abilities of the students / 

— Li— C. use Dest judgment when writing each item 

D. disregard objectives when teaching the content or process tested 



Check your answers with the\ey below. 

♦ 
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I ENABLING ELEMENT 7 

\ % ; The Reiatianship between Content : 

N - and Procefss Validity ' 

It is commohly emphasized that the classroom test should focus upon the 
•content actually studied in. the unit or module being tested, to the extent that it 
does, the test will possess qontenj: validity. To the eMent that it does not' the test 
lacks content validity. The students probably will.say that it is unfair. ' ^ 

Teachers have become concerned about the students attaining competence in 
utilizing certain cognitive processes arid skills and have n^e such attainments major 
objectives of .their instruction. Their tests should be vatid measures of the cognitive 
processes which were objectives of their instruction. 

, Thet>oint that sepms all too often to be misseci in the discussions of testing 
content d(Td^ testing processes is that content and. process necessarily are two 
dimensions of every test item. The student must employ some cognitive process in 
responding to^the content of each item, and no cognitive process can operate if it 
does not do so upon some content. The task of the test writer is to so bring content 
and jjrocess togethe^; in items that when responding, the^student will utilize the 
desired skills or processes In handling the content of the items. 

The diagram presented in Figure 2 represents the- two dimensional nature of 
content and process and offers'a technique by which the test Writer can plan to tie 
elements of content to the cognitive processes h6/she. wishes st-udents to utilize\in 
fprmu lating their responses. 
^ Each row of the' Figure is devoted to an element of the content presumably 
studied by the students for whom the test is to be written. If, in fact, each element 
has been studied, all items shown in its row will be valid in terms of content if they 
deal with that element. x 

Each coluhin is devoted to a process. The entries show the number of items 
utilizing each process and the elements of the content to which they are to be tied. 
'For instarrce, one "or more recall items are to be written about all the elements 
except nunrlber two and number six. Classification items are to be written about two 
'of the elements, etc. ' ^ 

The entry showing six items to be written which tie hypothesis development to 
thf element "habits causing poor nutrition" illustrates two important principles in 
the testing of content/process. While most , processes may be reduced to one or two 
steps, the more complex, of which hypothesis development is one, inherently 
require a numb^of sequential steps, and therefore require as many sequential items 
to pleasure thei^ , Hypothesis development really is a six-stqp process and requires 
six items to completely cover it. The second. principle is that each process must be 
tied 40 a content* element large enough to accommodate its complexity. "Habits 
causing poor nutrition" is large enough to accommodate the complexities of 
hypothesis cleveTbpment; others may not be. , 
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Figure 2, Test Planning in Terms of Content and Process 
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PRACTICE EXERCISE 8 

Check each of the following statements which are true.. 



V, If a test deals with the content actually taught it possesses. content 
. validity. ■ . -v. 



2: Answering each question requires the exercise of somq cognitive skill or 
process. 

3. It is possible to write t6st items which measure content and require the 
student to use no cognitive skill or processes. " 

4. Items may be wVitten which are pure measures of cognitive processes and 
skills and involve rto cc\)tent. ' . ^ 

5. Every item must deal with some content and responding to it requires 
some cognitive skill or process. " ^ . < 

6. Testing a sample skill or process requires only a small or specific bit of 
content.' - - ^ ^ 

7. Jesting complex or involved cognitive skills and processes requires that 
the student be given, or that 1>e already has, rather extensive blocks of 
content. - 

8. When planning attest! each element of contertt should Be tied to the 
cognitive skills or processes to be tested with it. 



Check your answers below. 



. y > 
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POST-ASSESSMENT 

In the column on the right below, five cognitive skills and processes are listed 
.and numbered. For .the item type listed in questidn 1, select the alternative wh^^ich 
records the numbers of the s'feveral cognitive skills and processes for.which items of 
that typye can be usgd effectively as measures. 

^ \ * c , ^ ' ^ 

Item Type / Cognitive Skills and Processes . 

1, Alternative response: , - • 

A. 1,3 ^ / ' 1. recall of information 

a n A 2. understanding 

r ^ ^ X opinion vs. fact 

* C. 4, 5 . ' - 4. sequencfng 

5. organization and expression 



D. 3,5 



of .personal reactions 



The statement in each of the two following items may, or may not, be a good 
guideline for th^riting of objective test Items. Read each, and choose the response 
which best describes the statement as a guicieline. ' 

2. Except for supply type items, the $tem plus the alternatives sfrould omit at least 
one element of in^ornpation required to respond to the item. 

• . A. exactly reversed; not correct * ' . 

correct as statec^^ ' * 

.C. ' even if correct, this would not beaguideMne. ' 

3. Errors students have made in the court of their study are .the best source of 
erroneous alternatives for test items. ' , * 

^, A, false, because the students should not meet their errors on test 

B. whether true or not, jt -is unethical to use them because their use will make 
the items tricky ' ^ 

C. correct as stated. 

Read the following" paragraph very carefully. You will npte that each sentence is 
numbered. After reading the paragraph, choose the alternative which lists the 
numbers of all sentences which are NOT correct.^ 



1. A test is valid 'to the extent that it is,reliable, that is, that it measures 
dependably what it does measure. 2. The validity of a test is very specific, that is, it 
may be valid as a measure of one thing arid possibly totally invalid as a measure of 
other things. 3.' Most tests that we construct are valid to some extent, but p'robably 
not'100% valid. 4. The same test wlf^be equally. valid as a measure-of a given body 
of l<nowledge if it is administered to two groups of students differing significantly in 



their command of basic skills. 5. The best a teacher can ^o when writing test kemt is 
to try to write each itenn so it wifl operate as a valid nneasure of what the teacher 
wants it to nrieasuje when given to the ciass for which it is written. 

4. In the above-paragraph, the sentences numbered are NOT correct: 

' 'A. 1, 3, 5 . ^ - . 

B. 2, 3,4 

C. 3, 5 ^ . ♦ . - 

D. 1,4 - - " 

-> • 

Read each of the numbered statements very carefi^ly and then select the 
alternative which lists the numbers of all that are FALSE. 

1. * If. the items in a test deal with the content actually covered in a unit or 

module, the test possesses conte'nt validity. / 

2. If the items require the students td employ the cognitive processes utilized ' 
in their study of the content, the test possesse;s process validity. 

3. Con^^ent can be tested without involving one or more cognitive processes. ' 

4. Each cognitive process musl be -tied to some element of content because ■ 
each process must operate upon some content; that is, processes cannot 
operate in the abstract. 

5. Any cognitlv^ process can be, tested by a single item if the item deals with 
Suitable content. - ^ 

5. I judge the FALSE statements to be: •* 

A. - 1,2,4 

B. 1,3,4 . ' ^ '. 

t 3,5- , 

'D. 2, 4 
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lEAKApyNG ELEMENT 8 

Exarnpfi^ of Content/Process Items . 



A. Recall ^ ^^Cp . <^ 

Recall is the process;\pf dal I ingSrfto consciousness (remembering) information 
stored in memory. It js basic fo^^llinti^llectual activity, and is economical of time 
and' effort. Recall mSy operate "iyitli^-^n^pl^ or complex, small or large segments of 
subject matter. ^ * / j 

C Examples ^ 

1. In terms of typical grocery store prices, froim which of the following co'qfd a 
^ person most lik^y get the aniount of protein needed for one day at the least 

cost? , , 

a. beef roast 
b» oranges 
c. dry beans 
. d. margarine 

2. Fill in the blank with a v^ord that makes this statement true: 
A good is a ^ ^ ^(Ife 

B. Classification . / 



m 

^■ron 



Classification is the process of putting together things, action^, or Events that 
bng together because of some basic, or general principle, characteristic, or tie. 



Examples 

1. Make an "X" before each 'of the following foods which ^properly may be 
classified as a carbotiydrate. 

Foods - . ^ 

^ 1. bread , _5. potatoes . 4 

2. butter • ___^6. cake 

1 3. bacon ' : 7. red-eye gravy ^ ^ 

4, jellv ' / . - i 

2. Make an "X" before each itehn below which is a service, ^ 
^ A. washing a customeF'sjcar , ' ' . \ 

. ^. an^orange ^ • 

C. an automobile 

D. , cutting a cusl|omer's hair ' « ' - 

' E. preparing a friend's tax, return ' , ■ . 
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Inference Making ► ' ' 

Inference making is the process of deriving an explanation of the reason \A<hy 
thipgs-happened as they did happen. \ 

, , Exanrjples 

A housewife began to: ' ^ 

1. selectxuts of meat with as little bone an^'fat as possible. * 

2. buy perishable fruits in smaller quantities. ' 

3/ select vegetables from open bins inst^d of prepackaged. 

4. serve food on children's plates. 

5. prepare casserole dishes from left-overs. * ^ 

I infer that her principal reason for doing all of these things was to: 

A. get.bejter buys in meats. " 

B. reduce waste. 

C. teach children ta eat properly. 

b. avoid buying spoiled fruits and vegetables. ' ^ ^ 



2. A lady showed her friends a hew chair she had purchased. Its design, fabric, 
frame and finish looked like that of a ^150.00 chair. There was no brand name 
on it. She said she paid about $80.0(J and that the store hiad other chairs like it. 
vShe ditin't tell where she bought it, bjjt I infer thtt it probably was a: 
- A. department store! . ^ . . 

B, discount store. ^ 

C, "name brand" furniture store. ^ ^ 

D, general store. 

. ■ ■ V 

D. Conceptualizing ' • . 

Conceptualizing -is the process of bringing seemingly unrelated and distinct 
tnings or events into a functioning whole. It is the process of developing a "big idea" 
, into Which a rilimbei; of ''different things or, events fit, and in terms' of whrchall of 
th^e associated de^aifs can be handled cognitively. * ■ 

The value of a concept demands upon the nupiber of apparerjtly separate thing^ 
or events in an, area it brings together. Typically, concepts "grow" with the study 
and experience of students^ Simply because concepts are powerful tools used'in'the 
process of thinking,' it if important in Consumers' Education that each of a few basic 
concepts "grow" as the students study and gain- experience in the field. 

In Consumers' Education, much of the testing pf the process of conceptualizing 
.will present items requiring the students correctly to relate new things or events to 
previxiusly acquired basic concepts. To correctly /elate new things or events to 
j^viously acquired basic concepts indicates that the basic concept has "grown'! 
j/the sense that 'the concept is larger and covers more things or events. Hence it is 
more useful and valuable. 
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• Examples » * , * 

L * * * V 

(For convenience both examples ^1 deal with the concepJt specialization.) 

1. Below is a list of five stores. Beside each store are the things the 4tore used to 
.sell. The next list tells what the store sells now. Sttrdy the lists. Then put an X 
by the two stores that have become more SPECI ALI^iQ. \ . 



Store Used to- Sell t ' Sells Now. 

Bill's ^ orangeade and lemonade "orangeade 

Joe's orangeade and lemonade nothing 



Ken's ' ^ orangeade and lemonade ^ ^ lemonade * ' 

John's orangeade and lemonade^ orange and lernonade 

Ben's orangeade and Ifemona^e lemonade and koolaide 

2. Below are four countries and a description gf their economies. Place an X by the 
two which need to increase in SPECIALIZATJON. 

Bongonia.is heavily industralized wjth 'very little agricultural production.'" 
The country's major exports have been in the natpre^of heavy machinery, while ' 
, innports have been consumer goods^and agricullui^^l pVqduct's. A major vyorld war* 
has broken out arid foreign trade has been comple^ply cu1^ off. 

\ c 

Amazonia i^^uaa^cantment with many oth^pt^untries. J}^ other countries / 
are all heavily industrial^dfed^but have very ine(^q^ti^^iculturai p^ 
Amazonia is self sufficient at a very low econofiBHb\?er. It bas rich farm lands, 
but devotes 90% of its , productive efforts tonndu$tri^ production.>^' This 
production is very inefficient due to the lack of adequate' mitral resources. 

Washmgtonia is an industrial country which p)rockrcesi!|heavy machinery. It 
relies on the sale pf the machinery to pay for its impJ^^ of .general consUrher 
goods. In recent years many other cpuntries hav/e^ bigwri^^jSpmpeting with 
/ Washingtonia and the country is'rapidly being forced ^ut OTtne Market. 

Ecolonia is a large country which has enjoyed tremendous ^economic success 
over the past two ^hundred years. The standard of living has been high, /due to . 
profits from large exports of agricultural and incjustrial products and raw 
V materials. Lately the gross nationa| product has declined due to -increasing 
shortages of minerals and wear on the land. ^ " * ^ 

E. Hypothesizing ' ^ ^^"^^"^ v - . - 

Hypothesizing, or the formulation of a tenable and ^estable,prediction based 
Lfpon the best available information is one of the more complex cognitive processes. 
As used under most circumstances in Consumers' Education*^, it requires that the 
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Yudent first examine the information available in order to figure out what 
iypoi^ant relationships exist amorig the facts or data in hand. It then requires that 
tHie'^tud&nt reason that if these relationships exist, making a certain change will lead 
to certain results. 

I An example may be helpful. In the previous'section entitled Conceptualizing, 
we^niay assume that Bill was operating a drink stand ws^ing orangeade and 
lenrionade.- Let us assume that after a week of operation he had the following 
information, or data. 

1. Some days he lost^ money, other days just broke even; and some days he 
made a littje. 

2. Each day he sold more orangeade than lemonade. 

• 3. At the close of each day, he threw out ^ lot of lemonade. 

4. At the close of each day, very little brangeade was left. 

5. Because (»f the cost of demons and sugar, his costs for lemonade were greater 
tharf the cosUoTorangeade. 

6. Many of those who bought lemona^ seemed to prefer it only slightly over 
orangeade. 

Examining the above information, it seemed to him that selling orangeade was 
profitable; selling lemonade, of .which he threw away a lot each day, led to^losses,/ 
and few customers really preferred lemonade much over orangeade. Bill now had the 
basis for his hypothesis, which he may have stated in this way: 

If selling orangeade is profitable; if selling lemonade is not; and if most^ 

customers like orangeade ^about as well as lemonade; then if I 'specialize by" 

selling only orangeade, I wOl make^ profit. 

Bill had stated a tenable hypothesis j^ecause it was based upon, and was 
consistent with the information he had to work with. Bill had made a prediction of a 
future outcome conditioned upon an action he could take. Bill had stated a testable 
hypothesis^ because he could specialize in orangfe'|de, and se5 whether or not he 
nnade 5 profit. 

. Bill's next step^ consistent with 'his hypothesis would be to specialize in 
orangeade, and to see whether or not after a pericfcl of time he had a profit. These 
actions are the test of his hypothesis. If he,4n fact, had made a profit, he would say 
4hat his hypothesis was confirmed, and he probably would continue^^is speciality. If 
he, in fact; broke even or haci a loss, he should reject his hypothesis, and start over 
again. Using. the total information he now has, he should ><te\(^lop ^newhypotheW 

and test it. J ^ ^ 

^ ^ « 

^ Examples v ' s 

1. Data Available: * A \ 

a. A nnother had three girls vijPose ages were 6, 4^nd 2. 

b. When the oldest started to school, she bought several dresses, each made of 
^very durable i^bric, and each quite expensive. 

c. The eldest eutgroi/v the dresses in one year. ' ' 

d. The second wore the dresses one yeac-when she became 

e. The third wore the dresses one year^en she became 6. 

f. The first loved the dresses; the second complained that -they didn't look like 
the other girls' dresses; and the third objeoted violently to tlie-ir style. 




Hypothesis ^ ' 

A. If the dresses made of doable but expensive fabric lasted over one year's 
^wear by each of the three girls, an^S if the younger girls complained about 
their being out of style, then t*his mother could reduce the complaints by 
buying dresses of much less durable fabric at a much lower cost for each gjrl 
- each year. \^ J * 

. V ^^^^ 

Is this?tekt hypothesis also tenable and testable? 



B. '-^f the dresses made of durable but expensive fabric continued to be of goot 
basic quaUty, but caused complaints by the younger girls because they. were 
out of style,^then this mother could reduce'the complaints by remaking the 
dresses befor^ they were worn by each successively younger girl. / 

Tenable X. Yes No . ' 

Testable: _ X Yes No 

Note: If the purpose is to reduce the complaints of the younger girls, there may 
be other factors to be taken into ac^unt before-the mother should decide 
which course of action to follow, that is, which hypothesis to test. Among 
such fetors are the cost/quality of the cheaper dresses and the time/cost of 
re'mak/q^ the expensive dresses. It is quite common in practice that such 
''other factors" enter into the decision of which of two or more equally 
tenable and'testable hypotheses actually should be tested. 



^. A real difficulty faced by ^tudents in develop+og-tooable and testable hypotheses* 
is determining \^hiph data among a mass of available data to use to develop a 
tenable/ani;! testable hypothesis. This example illustrates the problem. 

Data Available: ^ , , . 

From , advertisements 1n the daily paper, the following information was 
obtained about stores selling Lawnmowersn ^ ^ * 



Store 


Brand 

t 


Size 


Other . 1 n fo rpiatiorr—^ 


1. 

♦ 2. 


A 

B . 


21" 
18^ 


JMo service availal^le > - * 
^ Self-propelled 


3. 




24" 


Beautiful blue . * ■ ' 


4 


A 


■ 21" 


Full service free for 1 year'on mowers sold 


5. 


A 


21" 


Service available free first 6 months on 
* mowers sold. ■• , 

<> • 


Hypothesis: 









If a certai]^ piece. of goods has a^value, and if service has a value, then the 
sales prica of lawnmowers at the 'different stores will increase as the service 
offered increases. ; " ' , 

Put an "X" in front -of the stores whose advertisements, when taken 
together, make the above hypothesis tenable and testable.' 
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Answer: 1, 4, 5 (AH sell the same brand of mower in the same size, and differ 
' aniiong themselves only in terms of the amount of service offered without* 
' charge, Stores 2 and 3 sell other brands in other sizes and give no information 
w-about serviced The hypothesis is testable by goifig' to these same stores and 
obtaining their sales prices. If it is determined that the price at store' 1 is least, at 
stored 5 somewhat higher, and at. store 4, the highest, the hypothesis will be 
confirmed.)' 

F: G€ineralizfng o ^ , 

Generalizing is the process of developing a statement of relationships among a 
number of items or events,, or the process of applying a known broad principfe that 
can explain the occurrence of the items or events given. 

Note: The measurement of this process requires that the item furnish a number 
of details, or that it refer to a set of details which the writer is practically certain 
that the students alread>^ possess. 

Examples 

.1. A family bougbt a new household appliance. They paid in cash all but $100.00 
of the total cost. They agreed to pay the $100.00 and carrying charges in 
payments of $20.00 per month. The store gave them^ this schedule: 



Payment 
*. Number 


Total 
Payment 


. Paid to " • *' 
Balance-Due . 


Paid to 
Carrying Charge 


1 
2 

3. 
4 

6 


$ 20.00 
20.00 ' . 
20.00 
20.00^ 
20.00 
4.77*- . 


• $ 18.5a 
18.77 ' 
19.06' ^. 
19.34 
. 19.63 
4.7a 


$1.50 ■ . 
1.23 
.94 
.66 
.37- 
.07 


Totals 


•$104.77 


sioaoo 


$4-. 7 7 


In the^space below, write one statement which describes the changes that take place 
in the share of each'paymerit that goes to pay off the balance^ and in the share that 
jpoesto pay carrying charges as this type of credit account is paid off. 


Answe/ 




* 





2. Malnourished children whose mothers prepared few regular nrfeals ate mostly 
chips, bread and jfelly, sandwiches made with cold cuts and drank bottled soft 
• drinks. * . 

The children were brought into a school pro-am providing breakfasts with 
fruit, cereai, or eggs, toast and milk andjunches of cooked meats, potatoes, 
vegetables, salads, bread'aQd milk. They ate the bread, potatoes if fren^ fried, 
threw the rest of the food in the' waste can, and bought bottled drinks from.the 
store across t^^'-street. 

4 
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Which of th« following generalizations best explains the children's actions? 

A. Children will not eatfoods they have not learn'ed to Frke. 

B. Mothers tell their chilcfren not to eat what they were given. 

C. School" lunches cost money. ^ - .1 

D. The food would have made them sick. ^ ^ 



I 
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PRACTICE EXERCISE 9 



In this exercise, /ou are^given a section of content "entitled YOUR BREAK-" 
FAST CEREAL Then you wiH be a^ked to write test items illustrating each of the 
♦six cognitive processes presented under Enabling Objective 8. } 



YOUR BREAKFAST CEREAL 

What did you hav,e for breakfast this morning? Was it cereal fr'om a boxvyou or 
your'parents bought from a grocery stQre/ " ' . ^ 

We are going to pretend 'that you' *clid* have cereal, and that it vvas purchased 
from a store. Long ago, you would have had fewer choices to make\ There were 
fewer companies that'prodUced cereal in .boxes, and not as many stores seking it. • 
The companies didn't make cereal with the sugar already in it. People had less 
money to spend on the.purchase^ cereal, too. 

But this is today, not long ago. What happens when you decide ybu want cereal 
for breakfast? First, ypu must decide how much you wish to spend. Then, you ne^d 
to know something about the ^real you are thinking of buying. Hovy did you find 
out about it? Does anyone you-xnow eat it? Where can you get it?, * • 

Once you think you will like it and want to buy it, you may have a fev/hiore 
questions about the purchase 'of a particular cereal. Some cereals contain, mor-e 
vitamins than others; some have sugar ih*them and others do no^. Cereal boxes are 
different "sizes. Some bgxes have pri^ in them. AITof them cost money but each* 
different box cloes not cost the same amount. Can you think of some reasons why 
cereals cost different amounts? . • • ' 

Using the above content: . . - ^ ^ 

A. Write one recall item • - ^ 

B. Writrone classification item ' . , 



C. Write bne ifiference itenrf — ^ 

P.j Write one generalizing item. 
E. jWrite one conceptualizing item • 

■. \ 

' F. Write one hypothesizing item 

Cpmpaf.e the jtems with one.th? auth'o/ wrote. Do thpy s6em to be-similar in terms 
.of process? , ' * . ' / • • , 

49 . \ \ 



Illustrative Items 



A. Recall 



According to this story, what is the first thing you must decide when you start 
to choose which cereaUto buy?l;Place an "X" in'^frontof the right answer. ' 

A. i^hich kind you will not buy ^ , 

B, whether or not your friends eat cereal 



C. how much you* wish to spend 
.D. how big a box to buy 



B. Classification 

J \ 

Some of these things are true ndw and some were true long ago. Make an "X" in 
front of each thing that is true now, 

A. fewer choices of cereal • ' 



B. more companies produce cer-eal in boxes 

C* fewer stores selling cereal in boxes 

D. sugar was not already in the cereal 

E. people have more money to spend on cereal , 



inference ^ ^ 

' • /* - ' 

^ Although the story did not say exactly, \ think the statement below that I have 

marked "X" is true, . . - ' 

A. kids long ago ate more cereal than today * ^ 

B. rt was harder to choose cereal long ago than it is tod^y 

\C. people»eat more kinds of cereal today than they di^ long ago 

D. kids do not ask their Toothers to buy cereal so they can get prtees 

X Conceptualizing (Concept: choice) ' ' . * ^ 

> * 

TKe big idea is that- people must choose what* they will buy if there are many 
» Ithings they could buy, because they don't have the nnoney to buy, ordpn't 
want, everything. Put an "X" in front of the story below that describes a 
situation in which choosing is most necessary. 

_ A. Mr. Brown's store sells 15 kinds of cereal. Hg has most cefeals in 

^ " two or three sized boxes. Some have sugar, some vitamins, and 

^ ' * • some prizes. ^ ^ . • . 

— ' B. ' Mr. Jones' store sells rolled oats,^corn f lal^es, wheat and rice cereals. 
^All are ih 16 ounce boxes and are just plain cereal. 



E. Hypothdgizing 

' /' ' ' * ' 

If there^were fewer cereals to choose from long ago than there- are today, the 

older people ate the sanne kind of cereal much of the time when they were little 

children. Place an "X" in front of the statement below that identifies ah 

appropriate hypojhesis. * , ^ 

• A. There were fewer cereals long ago because^ the tastes of people were 

more limited/ * , ^ 

* ^ B. T+ierervyere fewer cereals' long ago because the incomes of people 

were less. 

. C. Children today have sweeter tastes than they had long ago. 

F. Generalizing 

^ ^^--^ . 

Make an "X" before the statement that is true. 

A. alUornpanies making cereal inake all kinds 

^ B. if you try, you can buy one cereal that has everything you want 

C. big boxes of one cereal always cost more than little boxes of any 

other cereal 

D. there are nnany more things to think about when you buy cereal 

today than there^ere long ago . 




ERIC 
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ENABLING ELEMENT 9 

• « 

^ Norm Referenced and Criterion Referericed Tests 

When a test has been prepared, administered 'lo the students, and the papers 
scored, the teacher obtains a test score, and only a test score, for each student. Each 
test score is a bit of, information to theeffect that the student earning it answered 
that many of the questions on -the test correctly* or received .that many credits for 
his efforts.. To m^ke a meaningful decision about the attainment represented by the 
test .score, the teacher must compare it with some generally understood and 
'accepted standard. The process of comparing a test score to some stated standard 
commonly is Known as referring the score; to that standard. 

In^current practice, Xeix scores are referred to one of two types of recognized 
standards. They may be referred to . the mid-score, or to the^ nuedian of the 
distribution of scores, earned on the same test by a group of students of the same 
general age and grade m school. The mid-score, or the median of the distribution of 
the scores of ^the group/ is defined as the norrrjal score. Jhe group is called the 
norming group! When scQrg&^f individual students are compared with norm" scores, 
it is said that they are being referred to a norm. Tests that provide a table that 
enables the teacher to compare the scores of individual students with norms ar£ said 
to be "norm referenced" tests. ' ^ y v . 

The second type of standard with which- individual scores may be compared is a 
pre-set and |tated number or percentage of items answered correctly. Th^t number, 
or percentage, is called the criterion score. Tests which provide a pre-set and stated 
number of items that must be answered correctly for a student's performance to be 
accepted as satisfactory ar^said to be "criterion referenced" testS; 

Students' scores obtained on a good test may be used in decision-making by 
referring them' either to norms or to criteria. The same test may be either norm 
referenced or criterion referenced. For deciding which of the students are in greatest 
need of) special help, or deciding whether or not help that has been given has been 
effective,' a norm referenced interpretation should be made. For deciding who has*, 
and who has not, attained a sufficient level of mastery to enable the student to go 
""on to the next u nit, a criter ion referenced interpretation should be made. Thus the 
. kinds of evaluative decisions to be made deterrhihe whether the teacher should 
interpret test results^on a norm referenced or criterion referenced manner. The 
following example may be helpfuL 

Example 

The students were studying a. mocitile on the computation^ of interest and other 
types of finance charges:- This module normally would be followed by one requiring 
the studgnt-s to compute alternative costs of purchasing a horpe and equipping it 

• with certain high cost ijems if each of two f mancing plar>s were used. 

*• > The teacher would 'need to make two types of evaluative decisions. The first 
decision was which of the students^ad, and (whicK had lOt,. attained a sufficient 




level of mastery to enable them to work with the 'content of the next module. The 
second decision was whether or not a special assistance program used by-the^ree 
students who typically scored lowest in the class had been effective. 

The teacher prepared a good ten-item test on the jnodule being studied. He/she 
nfiade the judgn^ent that all students answering correctly seven of the ten items were 
pVepared .to ur/dertake the next module. By m^aking this judgment the^ teacher set 
the criterion, and would be abfe to refer the score of each Student to it. The test 
could be used in a criterion referenced manner. 

\ The, three students who had received .the special assistartee program typically 
scored lowest in their class. By making Jhe rest of the class the norm group, that is, 
the group with whom their performance would be compared, the test could be used 
in«a norm referenced manner. . ' ' 

After scoring the- students" answers, the results were tallied as follows:* a zero 
tally mark (01 represents one of the three special help students and a straight tally 
mark (/) represents one of the other students.--- y r • 



Test Score Students ^ 

X 10 . ' , // 

A' 9 * /// „ ., 

. 8 . • , ■ 7^./// . • 

7^ ■ ' r-hU I 0 Criterion, 

e " ' / -00 

■ 5 ' ^-11 ^ 

3, 
2 

_ 1 ' * • 

Votal 25 



In the exannple how nnany nnet the criteriorr? Yes, twenty., How many did not? Th«y 
wbulcl have further work before attennpting the riext module. Do you see that using 
classroom tests in » ^iterionj:eferenced manner assists in the making of important 
evaluative decisions? ■ . 

In the example the three students jA/ho had received "the special prograrff are 
.represented by "O's." Typically, their test scores were the towest in the class. Their 
[J-ogram could be judged to have beep effective if they no longer scored lowest. Was 
the program effective? How does th^.|jse of the test results in a norm referenced 
manner shovy you this? Do you see that using test, results in a norhn referenced 
manner may help in the making of important evaluative decisions? 
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. EIMABLIIMG ELEMENT 10 

Reasons* for Considering Other ObservationakData 

There are two basic reasons for considering observational data other than test 
scores when evaluating student attainment. First, the objectives for most units of* 
instruction include some that can be assessed orHy by observing behavior other than 
test performance. Developing interests, changing attitudes, applications of what is 

/learned to out-of-sphool situations, independent exploration of related topifcs, etc., 
are examples of Such objectives. Behaviors related to such objectives must be 
observed when they occur and cannot be tested for formally. ' 

SecoQd, some' behaviors s^em to be indicative of change in cognitive learning, 
and many teachers feel, that their' occurfence should be weighed when evaluating 
student attainment. Participation in group or class discussion by v^^ithdrawn'children 

' seems to be indicative of improved cognitive learning. Bringing a picture or a short 
article pertaining to some phase of the topic and sharing it with peers may be a 
signal of better work to come. These behaviors too must be observed when they" 
occur, -and cannot be formally 'scheduled without losing their spontaneity and 
significance. ^ ' . „. 

behaviors which are the subjects' of, stated objectives should be observed and' 
fully considered when evaluating student attainment. Behaviors thought to be 
Indicators of. change for better or for worse in the level, of student attainment 
likewise should be observed and considered when devising teaching strategies and 
when evaluating student attainment-. - ' - 



'4 ' ' 
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ENABLING ELEMENT 11 



Techniques for R^ording Other 
Observational Data 



Observations of unscheduled student behavior, typically should be recorded as 
'anecd^s for use primarily by the teacher making the observations. For evaluative 
uses, thev need be preserved only for relatively short periods. 

As aNecdotes, they should report as precisely. as possible just what the student 
did, that is, behavior. A brief notation recording the setting, or circumstamces in 
which thi^ behavior occurred usually is helpful. Involved inferences about the' 
students' motives, or descriptions of the impact upon other students, the class or the 
teacher sh66 Id be omitted. In terms of style, the entries shouldbe informal, but- 
clear. , V 

The records may be kept in a simple notebook, or in an ordinary tablet. It is, 
good- practice to record on the first pape the types of behaviors to be looked for' 
bedaus^ they are directly stated' or 'implied in the unit objectives. Separate from 
these, but clearly noted, should hfi those behaviors which* the teacher.believes are 
indicators bf significant changes^ in student learning, and hence^ worthy of 
observation. If the combined list is, brief, it is more probgble/that the teacher 
actually willbe able to keep up with ^he task and end up with good data to work 
with. ^ r 

It is recommended that^e students' names be^\n;Eered alphabetically, one 



name to a page. The ruling of each page should provide one column for entering the 
date of each behavior'recorded, and the remainder of the page probably should be 
blank. Attennpts to record anecdotes on elaboratelyVuled pages rarely are successful 
^ bnd often are confusing! Each teacher may experir^ient with a recording system until 
a workable one is developed. ' ^ 
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POST-ASSESSMENt 

A teacher wrote, an item to measure a certain complex d^gnitive skill. 60% of the 
students marked the correct answer. The results established that: 



09gnit 



A. 40% of the students tried to use some oth^r skill 

B. 60% of the students got the answerxorrect by some.process 

C. 40% of the students could perform the skill but lacked basic knowledge 

D. all whp marked it corr^ectl^y can perform the skill. 



For each of the next two items, select the letter from the list below of the 
cognitive skill of process that students projDably would use in responding to it. You 
may use any skill or process as often as you wish. • - 

or Process 



hojfiers, 



A. generalizing^ - 

B. inference 

C. classification 

D. hypothesis development • ' 

c • 

2. Given the followin*g facts: 

a. insurance companies pay 3.5% interest to policyhojl 

b. national banks pay 4.5% on savings, 

c. savings and loan associations pay 5.0% on savings, - '^'^ 

If a person needed to borrow $10,000.00 to purchase a $50,000.00 home, which 
type of Jending agency probably would lend him the money at the lowest inter- 
est rate? ^ * * . ^ . 

Skill or 'process numbered" probably Vq^ld be used by students 

responding to this item. ^ . 

3, A girl fotmd-th3t-she=-cotild-tnv^^-i«-e^ 

the interest rates shown below: *' 

'U.S. savings bbnd-3. 75% . ' * 

national bank savings account— 4.5% 
savings and loan accouQ^t— 5.0% * ' . . 

first mortgage on a home— 6.5% . ' : 

second mortgage on a home~8.75% ; 

In one short sentence, what probably accounts for the increase in interest rate 
as the types of investment change as you read down through the list? 

• Skill or process numbered ^ probably would be used by students 

responding to this item. ' ^ . . ' , ^ " 
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A teacher , told a 'Student tharhis reading comprehehsion score indicated that he 
was reading two grades higher than his grade level. 

Obviously, the teacher was interpreting the student's test score in: ' ^ 

A. an unethical manner 4 , - ' 

B. a criterion referenced manner 

C. a norm referenced mapner 

D. an erroneous manner • ' . 

Which two of these possible reasons really are NOT proper justifications for 
considering observational data' other than test scores when evaluating student 
attainment? 



NOT Proper 
Justifications 

A- 1,2. 

B. 2,3 

C. 3,4 
d/ 2,4 



Possible Reasons 

1. Certain objectives can be, assessed 
only \f\ terms of the behaviors of 
students in the course of their 
activities, 

2. Some students do not do well on 
tests. 



3, Some things students do probably 
indicate, that changes in their 

• learning are taking place before 
the results show up.on test scores! 

4, Observations of other behaviors 
give the teacher a defensible basis 
for awarding better graders to some 
students and lower grades to other' 
student*. 
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The following paragraph contains statemeots describing a technique for 
recording observational data other than test scores. Tjot all of the statements 
may be correct. Read the paragraph carefully and chocfce the alternative which 
lists theTiumbers of the statements which are NOT corrects,, ^ ^ . 



The Numbers of the 
Statements that are 
NOT correct 

A. 3, 5 ^ 

B. 2,0' 

C. 1,4 

D. 2, 4 



• * \ A Technique for Recording 
Observational Data 

. 1. Observations of unsghe^jduled^ stijdent' 
behavior>^should be recorded as anec.-^ 
' dotes, primarily for use t^y the teacher 
^ making the observation. 

2. Each record should state, just what tlie 
student did and contain ^a brief nota- 
tion of th^' circumstances UYifier which 
the behavior bccutrred. 




Each entry also should contain the 
teacher's inferences about the students' 
motives and the affective effects upon 
other students. 

*^ior to making the actugl' observations, 
tnte teacher should decide just what 
behaviors she will look for, and list 
them, keeping the list brief. 

The behaviors to be observed may 
include any that interest the teacher, 
because she has no way of knowing to 
what she will relate therp. 

A simple notebooi^age for each pupil, 
listing his name, providing a column for 
dates, and blank space for recording the 
observed behaviors probably is the best. 
re,cord system to start with. 



/ 
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ENABUN& ELEMENT 12 



Ways of Using Observational Data 



V 

There is no single way of using observational data in^the making of evaluative 
decisions. There are no ways that are unive^saH^^^frect, and probably none that are 
universally wrong. The ways to use them are matters for the judgmem o'f each 
teacher, and they should be arrived at judicially, takirf^ into, acpount the situational ' 
factors in each c'ase and the.quafity of the data available/ j 

^Two types of mistakes may be made In dealing with observationardata. The 
first is to^JryUS^ssign numerical values to the observations and then to treat the 
•values assigned as if they we're measures of physical objects. They are not,^and 

• treating them as if they were i? a serious mistake. Even a simple count of the number 

• of observations of a given behavior may be niisleadmg b,ecause the number of times 
,^t occurred and vvas hot observed cannot be knov\^. The second type of mistake is to 

attempt a comple.tely unplanrfed approach to the use of observational data when 
evaluating student achievement. The results 'will be difficult to explain, and the 

--teacher may be accused Of being too severe with some students and too generous 
with others. Some reasonable rationale for the use of observational data in assigning 

^ student grades and in evaluatingclearning/teaPiing strategies is a practical necessity. 
In many situations, such observational data should sii^^lement test data and 
grades for class work-in effectvthey may furnis^tfth^ basis for adding a few points or 
for subtracting a few sa^ffffsT Usually either of these can be^done with gDod y 
judgment.' Another verV important use is in explaining to a student or to parents in a 
counseling setting^ wby the student is achiaving as he is, and identifying' things he 
could do to h^rove. Used in these ways pb^rvatiorial data-should make positive 

. contributions to evaluation and to learningi • - 

It usually is advisable for the teache?to begin to use such data by'considering\^ 
how best they may be used with the task at hand. From 'this deliberation, the 

• teacher should develop a few guiclelines.' B^eferring to the guideliqes from time to 
time, the teacher #111 maintain an 6ven-hdnded usage throughput :^the task. With 
experieQcgJ^ formulatingpersonal guidelines and in applying them, the real value of 

' ^uch observations almost Vertainlyv\/ill increase. ' 

^^^owever, there^are some behaviors^wbich^are highly valued in consumers' 
'^education, but simply are not observablje-life-^long persmial budgeting, perhaps. At 

any giv,en time and in any given setting, observaffonal da^ will not be complete, but / 

it should be better th^n none! , ' . , - * 



PRACTICE EXERCISE 10 

Other Observational Data 

♦ > ' * ' «^ ' 

Place a check before each of the statements below which is correct 

1. The asaessmen^-of many important objectives requires observation^ of 
behaviors other than test scores. . • 

* ' <■ 

2. Some behaviors are clues to important changes which students may be 
making. . 

3. Observations of what students actually do should be considered when 
assigning grades. ^ ^ 

^4. ^ It is not necessary to keep a record of such behaviors because the^ 
teacher will remember them, •anyway, 

5. A short list of behaviors to be observed helps the teacher by reminding 
him/her of the important things to be looked for. 

6. Records of observations should be brief anecdotes. ^ 

7. -/ Each teacher should experiment wifh ways of keeping records of 
observational data until he/she develops one that works well. 



Records of observations of students' classroom behaviors should be 
given numerical values and treated as test scorgs. 

9. Records of observations of studai*^ behavior are valuable for student 
and parent conferences. ' ^ 



10. Planning how he/she will use observational data will improve the use a 
teacher actually makes of them. ' 



% ^ 
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Organizational Note 

Up to this point the contents of this module have dealt with the objaining of 
data pertaining to student attainment. The material wa^ directed to the evaluation of 
the achievement of-the individual student. 

A professional responsibility of teachers is that of evaluating, making decisions 
about, the effectiveness of instructional sequences, units or m*odules as they actually 
were carried out in the classroe^ri. The purpose of these evaluations is to enable the 
teacher to make changes in the instructional strategies, in the instructional materials 
provided to ihe students, and in the teacher's own activities as th^ study and 
instruction progresses, or before the same topic is taught again. 

Meeting this professiomal responsibility requires an evaluation of three 
components. The first js the students' activities-the types of study in which they 
engage, time spent in each, estimates of the effectiveness of each for students of 
different types, arid contributions made by instruction in other classes and by 
out-of-school experiences. ' ' . 

The se^ind component is the instru(jjional materials provided., The evaluation 
should take into account their adequacy, availability, . dnd sui t ab ility for the students 
involved. > ^ 

The third component is the input of the individual teacher. The teacher's input 
largely is deterxnined by a basic %prasp f>f the subject matter, by planning efforts, by 
activities during the instruction, and by the demands made upon the^teacher for 
related and unrelated work with persons and groups other than the students. 

Within this module, the evaluation of the students' aclivities and tff the 
instructional niaterials will rrot b€ considered because of time limitations. The 
module will clos6 with a very brief treatment of the evaluation of the input of the 
teacher.* 
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ENABLIIViG ELEMENfla 



Reasons foft^ocumenting Teacher Input 

It is almost universalfy^accepte^that what the teacher puts into a learnihg/ 
teaching sequence influences directly what the students receive from their study. 
But the teacher may put in many things. Not all of them are obvious to students/ 
and sonn^ may not be recognized as inputs by the teacher. The first reason for 
documenting the things a teache> dojBs is to make them evident to the teacher, and 
to others who have reasons to be interested.and concerned. 

ItiiTTfact of life for teachers thaf they have only so much time and epergy that 
can be devoted to any given teaching task. The^effectiveness of their instruction is 
dependent on a very considerable extent upon \the way they di^ibute their time 
and effort among the principal activities in which they engage. The second r^son 
fo'r docymenting the things teachers dp is to enable theiT\ to readjust the distribution 
of their time and effort so that their total input may be more effective. 

In the final analysis, the basic reason for a teacher t6-record the types; the 
Amounts of time, .and possibly his/her judgments about the effectiveness of the 
activities related to a module, Ie9rning sequence, or.unit is to enable the teapher^to 
teach students more effectively: ^ 




. f NABLING ELEMENT 14 

Illustrative Forrn for Documentfng Teacher Input • ' 

The form in which teacher input, should be documented is'tbat v^fiich the 
teacher concerned .finds uBable and useful. Therefore^the form presented below is 
IHustrative of the pes of information w]iich,are usefol in making evaluative 
decisfons, and simple enough to be usable in most situations. Teachers shouJd 
experlrnent by modifying the form until, they develop one. which. they find mpst 
usefuT and usable. - , - ' ^ . 

The form presented' lists three broad classes of teacher inputs, namely: A. 
Planning^ and 'Direct' 'Preparation; B. Direct' Instruction; and C. Oth^ Related 
Activities. Each of the broad ctesses is sub-divided into* more' specific activities' 
related to it. For each of- the specific activities in which the- teacher engagecj, space is 
provided for recording the dates and the time spent on each date on tfVAt activify. 
The last column provides space for* recording the teacher's. notes and\omments 
about the conduct of each activity. - * * v ' 

The documented input, if kept current, may be very valuable tor formative 
evaluation purposes: For example, by glancjng over the previous day's entries the 
teacher can identify activities on which too much time was spfent3nti , those oh^ 
which 'too Nettle time was spent. As a basis for the summative evaluation of the 
learning/teaching sequence, the teacher-m^y add 'the number of minutfes spent on 
each activity and examine the grand 'tptal ahd the ' balance among, activities. 
Relationships between the^ kinds of things the students produced'and their levels of 
achievement ari^ the types-and extent of - teacher input prpbatHy w^ll become 
apparent. * - - • 

Documenting teacher input serves its purpose when it enables the tgacher'to 
adjust teaching- activ;ities while instrUctMon is in progress, or to adjust the distribution 
of teacher efforts the next time the unit is'taught. > 



• Figure 3, Teacher Input Form 



Consumers' Education 
' ^ ' . . / ^ ' 1 

N3me- ' ^ Topic ^ • • Class 

A. ' Planning and Direct Preparation 

" • i 

■ ' — ^ \H . ^ : 

Time • " \ ' > - . - 

• Date Spent \ . ' Activity » 



ERIC 



1. Planning teaching strategies and student activities. 



r 



' 2. Reviewing 'Content 



/ 



3. .Ass^blmg Materials 



II ' ' ' 

Total time spent'in Planning and Direct Pr(^aration , 
(add column 2) - ' ' v ' . ' ^ 



c • ^ • * ' , . 



9 



I c. 
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70 



y ■ * 




B. Direct Instruction 
Consumers' Education 




Date Spent 


— ^ 


m ■ 

. ' ActivitV'^ 


5 



■v 



1. Large group rnstruction 



2. Small groupMnstruction 



4ndiviciual instruction 



4 




0^ 



■4! Eyakjation ((fest preparation, scoring/, grading, 
observing students at work, etc.)-' ^ 



Total time^spent jaOirect Instruction (^dd coKimn 2) 

_j • ■ - - 
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C, Other Related Activities 
Consumers' Education 



Time ' ^ . \ ^ 

Date Spent ' Activity 

^ ~ ' ; — 

1. Formal inservige classes and seminars 



4 



2. Independfent study of the topic taught 



• 2 

RelatecTcc 



3. Relatec^committefe work 



4 ^ 

4/ Related community work 



Total time spent in ^ other related activities ^ (add 
. column 2)^ 
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PRACtlCE JXER^CISE 11 



3. W.hich of the following are v^lid reasons |pr a teacher to nn^ke'l record of his/her 
• activities? Check as nna"ny as are correct. ■ 



A. to help the teacher distribute his/ber time wisely 

B. ^ to prove that work was done 

C. ft) call to the tegcher's^ attention the types of related activities in 
which h'e/she did or possibly should have ertgaged. 



2. Classify each of the entries on the right 
' of teacher activity to which it belongs: 

_j Type 6f Activity 

A. Planning and Direct Preparation 

- a. Planning teaching strate- 
gies and student activities 
^ b. Reviewing content 



c. Assembling materials 



Direct Instruction 

d. Large group 



f. 
9- 



Stnall group 
Individual 
Evaluation^ 



by recording its number beside the type 



v 

1. worked with Susy ^ 

2. made plans for teaching "banking"' 

3. scanned chapter in the textbook 

4. prepared prQgram on Consumers' 
; Education for parents 

f- ^ 

5. attended extension, class ^ 

6. prepared test for unit ■ 

7. worked in library select-ing ma- 
terials for the class 



C. Other Related Activities 

h. Formal l,nservice 

: i. Independent study 

j. Related committee Work 

^ k. Related community work 



Check your answers with the key balow. 



ERLC ^ 
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POST-ASSESSMENT 

Listed^on the right are'pokible ways of using observational data. Choose frorri 
the alternatives on the left the one that lists the ways of using observational data 
that are NOT generally advisable^ ' • * 

NOT generally 

djtvis^ble ways ^ Possible Ways 

2, 3 ' I 1. Quantify them and treat the results mathe- 

\ ^ 'nnaticalfy. 2. Plan how best to use th^^ records for 

all students if^they will be used rn arriving at the 
: grade for anf Student. 3. ^Use the records for 

C. 3, 4 ^ coi^seling individual students and in conference 

^ ^ with individual student's parents. -4. Use them a^. 

D. 2, 3, 4 / -one part of a student's record, bujng aware that the 

\ . be|:>^or-s recorded cofnstitutd only a part of the 
' ^ t^tai of any student's behaviors. 5.-Use them in a- 
^conhpletely unstructured and unplanned manner so 
you\will not prejudice the behaviors of any 
student. ^ ' , • 

^Which ofthfe Posstol^' Reasons fisted is ^a>te)- .NOT valid, professionally as a 
re'asonlsy for ddcdmenting teacher input into the learDing/teaching process? 

NOT valid ' > '\ • . 

Ay 1 ^ f - 1. Documenting the' several things the teacher 

■ • does makes them evident to the teacher. . 

B-. 1,3 • * ■ • ' . . - . 

• 2^ Documentifig the^several things the teaclw^ 

3 ^ . . , ^ does pi-ovidej^ ^videncp that the te^achef did dA 

, ^ iSonnething. ^ " - \ ' . .r 



■D. 2 



3. ^Documenting the several things a teacher does 
• enables him/her to' redistribute his/her efforts 
' and thus become more effective. 



Classify the specific teacher activity given in each of the two following 
^ questions bV recording the letter number of the type of , teacher input to-which it 
belongs from the list on the right. 

Specific Teacher Activity* . ^ Type ol Teacher Input ^ 

3. Prepared presentation on Consum- A. Related Activities: Committee ^ 
ers' Education for parents' club B. ^ Related Activities: Community 
(2 hours) - C. Planning: Assembly Instruction 

Materials . 

i ., ' ' D. Direct Instruction^ Large Group 

4. Scanned text materials for the 
. ' unit (30 minutes) 



A. Planning: Assemble Materials 

- 6. Other Activities: Formal Inservice 

fC. Planning: Review of Content 

D. Direct Instruction: Individual 




t 

GROUP ACTIVITY 

Have teachers meet in small groups and analyze sonne t^stS that have examples of 
poor test itgms. Give reasons for their statements. 

Have teachers meet in small groups and construct well constructed test items. 
Allow time for large group discussion. ^ 
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